Lead Data Engineer
HiringHackerRank
Bangalore · IndiaFull-time· Today
Experience
6–6 yrs
Work Type
Full-time
Domain
SaaS, B2B
Leadership
Required
Core SkillsMust Have
StarRocksClickHouseDruidApache HudiApache IcebergDelta LakeTrinoPrestoApache SparkApache RangerAWSRBACdata securityaccess control
What You'll Do
1Own and evolve the data platform (StarRocks, Apache Hudi, Trino, Spark, Apache Ranger) ensuring performance, reliability, and security at scale
2Build the next-gen AI-optimized data layer for natural language querying and AI add-on features
3Own in-product data features - exports, insights dashboards, interview analytics, and Custom Reports interface
4Enable self-service pipelines for internal teams (AI platform, analytics, go-to-market)
5Enforce robust data security - access controls, Apache Ranger policies, and confidence-scoring guardrails for AI outputs
6Lead technical design reviews and define engineering standards for the data team
7Partner with PMs and business stakeholders to identify and scope AI-enabled data use cases
Nice to HaveOptional
AI/LLM-adjacent data workconfidence scoringagentic pipelinesRAG architecturesvector storesagentic workflowsnatural language queryingbuilding data products for end-customer consumption
Domain
SaaSB2B
Industry
SaaSB2B product company
LeadershipMentoring or team leadership preferred
StartupPrior startup experience preferred