Job Objective
At Miare, we are seeking an experienced and highly skilled Data Platform Engineer to design, build, and operate a governed, self-service data platform. The platform will empower every team to create and document their own analytics while maintaining a single source of truth for company-wide metrics.
In this role, you will own ingestion, transformation, testing, and documentation automation—while enabling domain teams to safely extend the platform. If you are passionate about building robust, scalable data infrastructure and thrive in a high-autonomy environment, this role is for you.
Key Responsibilities:
- Design, implement, and operate ingestion pipelines from operational databases and APIs into ClickHouse (raw → staging → core).
- Deploy and operate Airflow from day one to orchestrate ingestion, dbt runs, tests, and documentation publishing.
- Build and maintain dbt models (core and staging) with tests, documentation, and ownership metadata.
- Implement version control and CI/CD for transformations using GitLab CI + dbt.
- Enable self-service modeling: create schemas, templates, onboarding guides, and governance rules.
- Ensure data quality and observability with dbt tests, freshness checks, and row count monitoring.
- Automate documentation generation and publishing after every change.
- Collaborate directly with product, operations, and analytics teams to align KPI definitions and SLAs.
- (Future phases) Integrate Airbyte/PeerDB, Airflow/Prefect, or Kafka for scaling needs.
Task Complexity:
- This role requires designing and operating data infrastructure in a lean, high-autonomy environment. You must balance governance with speed, ensuring data quality and documentation while enabling rapid scaling. Success demands a product-engineering mindset, combining strong technical expertise with the ability to empower other teams for self-service analytics.
Requirements:
- 3+ years of experience building and running data platforms (beyond BI SQL reporting).
- Proficient in SQL and Python, with strong code quality and version control discipline.
- Hands-on experience running dbt in production, including tests and documentation.
- Proven experience deploying and managing Airflow DAGs for ingestion and transformation.
- Understanding of columnar OLAP engines (ClickHouse, BigQuery, Snowflake, etc.).
- Knowledge of idempotent design, partition swaps, and incremental model patterns.
- Strong focus on governance, performance, and reliability.
- Ability to work independently and think like a product engineer.
Skills:
- Data pipeline design and orchestration.
- Production-level dbt and Airflow expertise.
- CI/CD, version control, and automated testing for data workflows.
- Strong analytical and problem-solving skills.
- Effective cross-team collaboration (product, operations, analytics).
Preferred Skills:
- Production experience with ClickHouse (merges, partitioning, deduplication).
- Experience onboarding teams to self-service analytics in dbt.
- Built ingestion pipelines from APIs or CDC tools (e.g., Debezium).
- Experience creating CI/CD pipelines for dbt with automated tests and documentation.
- Familiarity with introducing AI copilots into data workflows.
Education:
- Bachelor’s or higher degree in Computer Science, Data Engineering, or related fields.
Benefits & Perks:
- Location: Miare Headquarters – Sharif Innovation Station (Tarasht, Tehran).
- Lean, fast-paced, and autonomous environment with direct collaboration across product and operations.
- Free supplementary health insurance.
- Eligibility for Knowledge-Based Company military service exemption (after one year).
- Full legal benefits including annual bonus, severance, and New Year bonuses.
- Salary: Up to 80M Toman.