Lead Data Engineering Services
Seeking to hire a Contractor based out of Brazil or Argentina for Lead-Level Data Engineering Services.
Scope of Services:
As a Contractor you will work alongside app developers and data stakeholders to create data system changes and to respond to data inquires
You will Lead initiatives and problem definition scoping, design, and planning through epics and blueprints.
With your deep domain knowledge and radiation of that knowledge you will develop documentation, technical presentation, discussion, and incident reviews.
You will build and maintain data pipelines and DAG tooling
You will establish and maintain a data catalog with business-related metadata
Skills & Experience:
Mastered proficiency in SQL, Python, and relational datastores (columnar and row databases)
Proficiency in building and maintaining data pipelines and DAG tooling (Dagster, Airflow, etc)
Advanced experience with event-based pipelines and CDC tooling
Advanced experience in managing large-scale data migrations in relational datastores
Advanced experience in optimizing SQL query performance
Advanced experience with data testing strategies to ensure resulting datastores are aligned with expected business logic
Experience with DBT orchestration and best practices
Experience with enabling monitoring, health checks and alerting on data systems and pipelines
Experience establishing and maintaining a data catalog with business-related metadata
Experience building tools and automation to run data infrastructure
Experience with writing and maintaining cloud-based infrastructure for data pipelines (AWS, GCP and Terraform) is a plus
Experience in document, graph or schema-less datastores is a plus
Please note that given the nature of the contract, this role will not be eligible to participate in company-sponsored benefits.
About the job
Apply for this position
Lead Data Engineering Services
Seeking to hire a Contractor based out of Brazil or Argentina for Lead-Level Data Engineering Services.
Scope of Services:
As a Contractor you will work alongside app developers and data stakeholders to create data system changes and to respond to data inquires
You will Lead initiatives and problem definition scoping, design, and planning through epics and blueprints.
With your deep domain knowledge and radiation of that knowledge you will develop documentation, technical presentation, discussion, and incident reviews.
You will build and maintain data pipelines and DAG tooling
You will establish and maintain a data catalog with business-related metadata
Skills & Experience:
Mastered proficiency in SQL, Python, and relational datastores (columnar and row databases)
Proficiency in building and maintaining data pipelines and DAG tooling (Dagster, Airflow, etc)
Advanced experience with event-based pipelines and CDC tooling
Advanced experience in managing large-scale data migrations in relational datastores
Advanced experience in optimizing SQL query performance
Advanced experience with data testing strategies to ensure resulting datastores are aligned with expected business logic
Experience with DBT orchestration and best practices
Experience with enabling monitoring, health checks and alerting on data systems and pipelines
Experience establishing and maintaining a data catalog with business-related metadata
Experience building tools and automation to run data infrastructure
Experience with writing and maintaining cloud-based infrastructure for data pipelines (AWS, GCP and Terraform) is a plus
Experience in document, graph or schema-less datastores is a plus
Please note that given the nature of the contract, this role will not be eligible to participate in company-sponsored benefits.