متن کامل آگهی:
We are seeking a visionary and hands-on Data Engineering Team Lead to build, mentor, and guide our data engineering team You will be responsible for the strategic direction and operational excellence of our data platform, ensuring it scales to meet the evolving needs of the business This role blends technical leadership, people management, and architectural oversight, empowering you to shape the future of data at our company
Responsibilities
Leadership & Strategy
Lead, mentor, and grow a team of high-performing data engineers, fostering a culture of collaboration, innovation, and continuous improvement
Define the long-term technical vision and roadmap for the data engineering platform in alignment with business goals
Own the end-to-end delivery of data projects, ensuring they are completed on time, within scope, and to a high standard of quality
Act as the primary point of contact for data engineering, effectively communicating with senior leadership, product managers, and other stakeholders
Manage team priorities, project allocation, and capacity planning
Technical Execution & Architecture
Oversee the architecture, design, and implementation of our core data platform using Apache Airflow, Apache Spark, Apache Kafka, ClickHouse, S3, and our data lakehouse
Drive the adoption of best practices in data engineering, including data governance, data quality, security, and CI/CD (using Kubernetes, Helm, and GitLab CI/CD)
Make critical architectural decisions on technology selection, data modeling, and system design to ensure scalability, reliability, and cost-efficiency
Hands-on contribution to the codebase for critical components, complex ETL pipelines, and platform enhancements
Champion an "automate everything" mindset and oversee the development of internal tools and RESTful APIs to streamline processes
Collaboration & Enablement
Partner closely with Data Scientists, Data Analysts, and business units to understand their needs and translate them into a robust, scalable data strategy
Ensure the platform provides reliable, timely, and high-quality data to fuel analytics, machine learning, andbusiness intelligence
Establish and monitor SLAs for data pipelines and platform services
Requirements
6+ years of experience in data engineering, with at least 2 years in a leadership or tech lead role
Proven experience in hiring, mentoring, and managing a team of data engineers
Deep expertise in the modern data stack: Apache Airflow, Apache Spark, Apache Kafka, and ClickHouse (or similar OLAP databases)
Strong experience with cloud object storage (S3), data lakehouse architectures, and containerization (Docker, Kubernetes)
Mastery of at least one programming language, preferably Python or Java, for building robust data pipelines and services
Extensive background in designing and building large-scale, reliable ETL/ELT pipelines, data modeling, and data warehousing
Excellent communication and stakeholder management skills, with the ability to explain complex technical concepts to non-technical audiences
Bachelor's or Master's degree in Computer Science, Engineering, or a related field