Senior Data Engineer

At Azki’s Data Team, we are looking for a responsible and skilled problem-solver to help us design, build, and scale reliable data infrastructure that powers analytics, products, and business decisions.


Responsibilities

• Work closely with data team members and other teams to design and implement scalable data pipelines.
• Build, maintain, and optimize data processing workflows using Kafka, Spark (Scala/Python), and MySQL/ClickHouse.
• Ensure data quality, integrity, and availability across our data platforms.
• Develop and manage data models and storage solutions that support analytical and product use cases.
• Automate data ingestion, transformation, and delivery processes.
• Monitor and improve the performance of pipelines and queries in ClickHouse, MySQL, and other systems.
• Collaborate with analysts, data scientists, and product teams to enable self-service analytics through tools like Metabase and Zeppelin.
• Contribute to the evolution of Azki’s data platform architecture, ensuring scalability, security, and reliability.

Required Skills

• At least 5 years of relevant experience in data engineering or backend data infrastructure.
• Strong skills in SQL and experience with databases such as MySQL and ClickHouse.
• Hands-on experience with streaming and batch processing systems (Kafka, Spark).
• Proficiency in both Scala and Python for data engineering and pipeline development.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Experience with workflow orchestration and version control (e.g., Airflow, GitLab).
• Strong problem-solving skills with the ability to design and implement robust, scalable data solutions.
• Effective communication and teamwork skills for working with cross-functional teams.
• Strong proficiency in Linux environments, including shell scripting, system monitoring, and troubleshooting.
• Hands-on experience with Docker for containerization and deployment of data services.

Preferred/Optional Skills

• Experience in mentoring and supporting team members in their career growth, including close collaboration and pair work to improve project outcomes.
• Familiarity with data visualization and BI tools such as Metabase.
• Knowledge of best practices for data security, governance, and compliance.