Senior Data Engineer

Overview We’re looking for someone who can architect a real data platform, not someone who just writes ETL jobs. This is a founding role with full ownership over how data moves through our system. You will design the ingestion, transformation, storage, and modeling layers that power our AI‑driven analytics. You’ll have the authority to rebuild pieces that don’t scale and the responsibility to choose technologies that can support long‑term growth. If your strength is pipeline architecture, distributed systems, and building durable patterns, not just maintaining jobs, this role is built for you. About ProfitPeak ProfitPeak is an adaptive operating platform designed to power profitable e‑commerce brands globally. We simplify decision‑making by automating the translation of insights into action across inventory, customers, and advertising. As a post‑revenue, global venture‑funded company, we have earned multiple global awards and equity‑free grants. Founded by seasoned entrepreneurs who successfully exited large e‑commerce brands, we have leveraged this experience to build a platform that helps brands and retailers scale worldwide. Responsibilities Architect the full AWS‑based data platform for high‑volume event ingestion, transactional data, identity stitching, and product analytics. Redesign existing ingestion paths where needed (currently built around Kinesis) to improve reliability and throughput. Build real‑time and batch processing layers using Flink, Glue, EMR/Spark, or custom microservices, whichever best fits the problem. Own analytical storage (currently ClickHouse), including schema design, materialization strategies, performance tuning, and retention. Define the data models that power profitability analysis, customer journeys, funnels, attribution, and operational metrics. Establish workflow orchestration using the right framework (Airflow, Dagster, Prefect, or AWS‑native tools). Implement data quality, lineage, SLAs/SLOs, monitoring, and fault‑handling across all pipelines. Lead data governance and compliance; access controls, retention policies, and secure handling of identity‑level data. Use Pulumi for infrastructure‑as‑code and versioned infrastructure deployments. Introduce practical CI/CD for data jobs, infra updates, schemas, and tooling automated, predictable, and lightweight. Work directly with founders to define long‑term data architecture, technical direction, and scaling strategy. Qualifications 4+ years building and scaling data systems with strong emphasis on architecture, not just ETL execution. Deep experience with the AWS data stack: Kinesis, Lambda, SQS, EventBridge, Glue, EMR/Spark, IAM. Strong engineering fundamentals in Python and SQL; able to create reusable frameworks, not one‑off scripts. Experience working with or redesigning analytical databases (ClickHouse, Redshift, Snowflake, BigQuery). Fluency in event‑driven architectures, streaming joins, backpressure handling, and real‑time processing semantics. Experience implementing governance, compliance, data retention, and privacy controls. Pulumi or equivalent IaC experience with consistent automation practices. Ability to make architectural calls with incomplete information and refine them as the product evolves. Startup‑ready: you can operate with autonomy and make decisions that impact the trajectory of the entire platform. Nice to Have Deep familiarity with ClickHouse performance characteristics. ML‑oriented data pipeline experience. Ability and interest in building a data team later. Seniority Level Mid‑Senior level Employment Type Full‑time Job Function Information Technology Industries Software Development #J-18808-Ljbffr