Lead Data Engineer
About Us:
Everstream Analytics is a technology-driven company that is revolutionizing Supply Chain Risk Analytics. We’re looking for a talented and experienced Lead Data Engineer to join our team.
What You’ll Do:
Management: Manage and grow a remote team of data engineers based in Europe.
Architect Data Solutions: Collaborate with Platform and Data Architecture teams to deliver robust, scalable, and maintainable data pipelines.
Lead Data Initiatives: Lead and own data engineering projects, including data ingestion, transformation, and storage.
Real-Time Data Processing: Develop and optimize real-time data processing pipelines using technologies like Apache Kafka/MSK or similar.
Data Lakehouse and ETL: Design and implement data lakehouses and ETL pipelines using AWS services like Glue or similar.
Data Modeling and Optimization: Create efficient data models and optimize database queries for optimal performance.
Collaborate with Stakeholders: Work closely with data scientists, product managers, and engineers to understand data requirements and translate them into technical solutions.
Mentor and Guide: Mentor junior data engineers and share your expertise. Establish and promote best practices.
What You’ll Need:
Strong Python Proficiency: Deep understanding of Python, including data manipulation and analysis libraries like Pandas and NumPy or similar.
Data Engineering Expertise: Extensive experience in data engineering, including ETL, data warehousing, and data pipelines.
Cloud Platform Proficiency: Strong knowledge of AWS services, such as RDS, Lake Formation, Glue, Spark, etc.
Real-Time Data Processing: Experience with real-time data processing frameworks like Apache Kafka/MSK.
Database Skills: Proficiency in SQL and NoSQL databases, including PostgreSQL, Opensearch, and Athena.
Data Modeling: Ability to design efficient and scalable data models.
Problem-Solving and Analytical Skills: Strong analytical skills to identify and solve complex data problems.
Collaboration Skills: Excellent communication and collaboration skills to work effectively with cross-functional teams.
Why Join Us:
Impactful Work: Contribute to data-driven decision-making and product innovation.
Collaborative Culture: Work with a talented, passionate team from across the world.
Continuous Learning: Opportunities to learn new technologies and skills.
Competitive Compensation: A competitive salary and benefits package.
We are looking for a hands-on Lead data engineer who is passionate about data, enjoys solving complex problems, and is excited to build and lead scalable data teams and solutions.
100% Remote Position
#LI-
Lead Data Engineer
About Us:
Everstream Analytics is a technology-driven company that is revolutionizing Supply Chain Risk Analytics. We’re looking for a talented and experienced Lead Data Engineer to join our team.
What You’ll Do:
Management: Manage and grow a remote team of data engineers based in Europe.
Architect Data Solutions: Collaborate with Platform and Data Architecture teams to deliver robust, scalable, and maintainable data pipelines.
Lead Data Initiatives: Lead and own data engineering projects, including data ingestion, transformation, and storage.
Real-Time Data Processing: Develop and optimize real-time data processing pipelines using technologies like Apache Kafka/MSK or similar.
Data Lakehouse and ETL: Design and implement data lakehouses and ETL pipelines using AWS services like Glue or similar.
Data Modeling and Optimization: Create efficient data models and optimize database queries for optimal performance.
Collaborate with Stakeholders: Work closely with data scientists, product managers, and engineers to understand data requirements and translate them into technical solutions.
Mentor and Guide: Mentor junior data engineers and share your expertise. Establish and promote best practices.
What You’ll Need:
Strong Python Proficiency: Deep understanding of Python, including data manipulation and analysis libraries like Pandas and NumPy or similar.
Data Engineering Expertise: Extensive experience in data engineering, including ETL, data warehousing, and data pipelines.
Cloud Platform Proficiency: Strong knowledge of AWS services, such as RDS, Lake Formation, Glue, Spark, etc.
Real-Time Data Processing: Experience with real-time data processing frameworks like Apache Kafka/MSK.
Database Skills: Proficiency in SQL and NoSQL databases, including PostgreSQL, Opensearch, and Athena.
Data Modeling: Ability to design efficient and scalable data models.
Problem-Solving and Analytical Skills: Strong analytical skills to identify and solve complex data problems.
Collaboration Skills: Excellent communication and collaboration skills to work effectively with cross-functional teams.
Why Join Us:
Impactful Work: Contribute to data-driven decision-making and product innovation.
Collaborative Culture: Work with a talented, passionate team from across the world.
Continuous Learning: Opportunities to learn new technologies and skills.
Competitive Compensation: A competitive salary and benefits package.
We are looking for a hands-on Lead data engineer who is passionate about data, enjoys solving complex problems, and is excited to build and lead scalable data teams and solutions.
100% Remote Position
#LI-