At Okala, we are changing the game in the Fast-Moving Consumer Goods (FMCG) sector, creating a new online grocery shopping experience for Iranians. Our Data team collaborates to make it happen. We have an exciting opportunity for you to join us as a crucial part of our team as a Senior Data Engineer.Responsibilities:Data Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines and ETL processes.Collaboration: Work closely with data analysts, data scientists, and software engineers to gather data requirements, ensuring data integrity and quality.Stream Processing: Utilize frameworks like PySpark for efficient real-time data processing.Distributed Systems: Employ message brokers like Kafka for data transportation and processing in distributed environments.Database Management: Develop and maintain data models and database schemas to meet business needs.Database Technologies:Experience with both SQL (Click House, SQL Server) and NoSQL databases (MongoDB, Redis) for structured, unstructured, and semi-structured data management.Familiarity with containerization and orchestration tools like Docker and Kubernetes.Programming & Problem Solving: Apply strong Python or Scala skills and analytical abilities to solve complex data challenges.Communication & Collaboration: Demonstrate excellent communication and teamwork skills.Requirements:Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.Experience: Proven track record as a Data Engineer or in a similar role.Programming Skills: Proficiency in Python or Scala.Frameworks & Tools:Experience with stream processing frameworks, notably PySpark.Familiarity with message brokers such as Kafka and RabbitMQ.Knowledge of SQL databases, specifically Click House and SQL Server.Experience with NoSQL databases (e.g., MongoDB, Redis) and object storage solutions like Minio.Familiarity with containerization and orchestration technologies, including Docker , Airflow and Kubernetes.Familiarity with data integration tools like Microsoft SSIS and Apache Nifi.Analytical Skills: Strong problem-solving abilities and analytical thinking.Soft Skills: Excellent communication and collaboration skills.Benefits:Join our friendly and dynamic team and enjoy a range of perks, such as:Seasonal and special charges and discounts from OkalaProfessional development opportunitiesBreakfast every dayBirthday and anniversary gifts and surprisesLunch subsidiesTransportation budgetOn-site medical careComprehensive health insuranceParking space