Data Engineer

Masuda Group is seeking a Data Engineer to architect, build, and optimize large-scale data ingestion, processing, and storage systems across our Experience Management (XM) platforms and analytics infrastructure.

In this role, you will develop robust batch and real-time streaming pipelines that handle millions of events and survey responses daily, powering low-latency analytics dashboards, reporting engines, and machine learning models.

• Languages: Python, Java, SQL
• Warehousing & Databases: ClickHouse, PostgreSQL, Google BigQuery, AWS Redshift
• Streaming & Messaging: Apache Kafka, Apache Spark Streaming, RabbitMQ
• Orchestration & Transformation: Apache Airflow, dbt
• Storage & Formats: Parquet, DuckDB, Amazon S3, Google Cloud Storage
• Cloud & DevOps: AWS, GCP, Docker, Kubernetes, Terraform

• Build and maintain high-throughput streaming and batch data pipelines using Apache Kafka, Apache Spark, and Python / Java.
• Model, tune, and manage analytical databases in ClickHouse and PostgreSQL for high-performance aggregation and complex analytical queries.
• Implement automated ETL / ELT workflows using Apache Airflow and dbt, ensuring data freshness and lineage tracking.
• Architect scalable data lake storage layers on AWS S3 and GCP using columnar formats such as Parquet.
• Develop automated data quality checks, schema evolution handling, and anomaly detection to guarantee data integrity.
• Collaborate with backend engineers, data analysts, and machine learning engineers to deliver reliable data models and feature stores.
• Optimize query execution plans, partitioning strategies, and database indexing to minimize latency and compute costs.
• Enforce data security best practices, access controls, and GDPR/CCPA compliance standards across all data tiers.

• 3+ years of professional experience as a Data Engineer building production data pipelines and warehouses.
• Advanced proficiency in SQL and deep experience in columnar data modeling and query optimization.
• Strong programming skills in Python or Java for data processing and pipeline development.
• Hands-on experience with columnar analytical databases, especially ClickHouse or BigQuery.
• Demonstrated experience with real-time event streaming architectures using Apache Kafka.
• Proven track record orchestrating workflows with Airflow or dbt.
• Experience working with cloud platforms (AWS or GCP) and containerization with Docker.
• Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or equivalent practical industry experience.

• Experience with Kubernetes orchestration for distributed data workloads.
• Experience managing multi-terabyte ClickHouse clusters with replication and sharding.
• Experience implementing automated data quality frameworks and data governance tooling.

• Competitive compensation package.
• Flexible remote work environment with modern cloud infrastructure.
• High-impact role shaping core data architecture and analytical capabilities.
• Professional growth, certification sponsorships, and career development.