Data Engineering Manager - Data Lake
Summary
Data Team plays a central role at Pismo, providing Data-Intensive Analytics for internal product teams, also processing and delivering TBs of high-quality data, needed by our Partners to produce outstanding products downstream. Operating mainly in Brazil, the data team recently extended its scope to accelerate the Platformization of data services globally, with representatives in Europe and soon to the US and Asia. We are looking for talented leaders who share our culture of trust, mutual responsibility, and technological excellence to be part of this unprecedented and diverse global Data Organisation.
What you'll do
As the Manager of Data Engineering at Pismo, you will lead a team responsible for our Data Lake and corporate data platform. Your critical role involves ensuring the Data Lake meets quality standards, Service Level Objectives (SLOs), and Service Level Agreements (SLAs), while continuously evolving the platform.
Minimum Qualifications
At least 3 years managing Data Platform teams.
Concrete previous hands-on experience as a Data Engineer, Analytics Engineer, Data Scientist, Software Engineer or Machine Learning Engineer.
Negotiation and communication skills to deal with different levels of stakeholders.
Big Data Architecture
Parallel processing with Apache Spark.
Experience with Python, SQL and Orchestration Tools (eg. Airflow).
Desirable Qualifications
Experience Developing automated Unit and Integration tests for data pipelines;
Experience using notebooks for data exploration (e.g. Jupyter, Databricks, Hex);
Experience consuming data-intensive distributed messaging processing systems (e.g. Kafka, SQS, Pub-Sub, Pulsar, Kinesis);
Experience developing and maintaining CI/CD for Data Pipelines (e.g. CodeFresh, Jenkins, etc);
Core Benefits
Remote work
Flexible hours
Gympass
Meal & Food vouchers
Remote work financial support
Life Insurance
Medical and Dental
Assistance Employee child care benefit: daycare
Private Pension (2x1)
Vidalink partnership
Day off (Birthday)
Support for studying languages
50% off AWS and GCP certifications
Sesc Partnership
Performance Incentive Plan
Technologies that we apply in our day
AWS Services;
Data Processing: Spark, Flink
Python
Airflow
Relational databases (PostgreSQL and MySQL)
About the job
Apply for this position
Data Engineering Manager - Data Lake
Summary
Data Team plays a central role at Pismo, providing Data-Intensive Analytics for internal product teams, also processing and delivering TBs of high-quality data, needed by our Partners to produce outstanding products downstream. Operating mainly in Brazil, the data team recently extended its scope to accelerate the Platformization of data services globally, with representatives in Europe and soon to the US and Asia. We are looking for talented leaders who share our culture of trust, mutual responsibility, and technological excellence to be part of this unprecedented and diverse global Data Organisation.
What you'll do
As the Manager of Data Engineering at Pismo, you will lead a team responsible for our Data Lake and corporate data platform. Your critical role involves ensuring the Data Lake meets quality standards, Service Level Objectives (SLOs), and Service Level Agreements (SLAs), while continuously evolving the platform.
Minimum Qualifications
At least 3 years managing Data Platform teams.
Concrete previous hands-on experience as a Data Engineer, Analytics Engineer, Data Scientist, Software Engineer or Machine Learning Engineer.
Negotiation and communication skills to deal with different levels of stakeholders.
Big Data Architecture
Parallel processing with Apache Spark.
Experience with Python, SQL and Orchestration Tools (eg. Airflow).
Desirable Qualifications
Experience Developing automated Unit and Integration tests for data pipelines;
Experience using notebooks for data exploration (e.g. Jupyter, Databricks, Hex);
Experience consuming data-intensive distributed messaging processing systems (e.g. Kafka, SQS, Pub-Sub, Pulsar, Kinesis);
Experience developing and maintaining CI/CD for Data Pipelines (e.g. CodeFresh, Jenkins, etc);
Core Benefits
Remote work
Flexible hours
Gympass
Meal & Food vouchers
Remote work financial support
Life Insurance
Medical and Dental
Assistance Employee child care benefit: daycare
Private Pension (2x1)
Vidalink partnership
Day off (Birthday)
Support for studying languages
50% off AWS and GCP certifications
Sesc Partnership
Performance Incentive Plan
Technologies that we apply in our day
AWS Services;
Data Processing: Spark, Flink
Python
Airflow
Relational databases (PostgreSQL and MySQL)