AI Data Engineer
Bengaluru, Karnātaka, India
INR 1340K-1680K (estimate) Mid-level Full Time
Tasks
- Administer and extend Collibra data governance platform
- Build and maintain Power BI semantic models
- Build and manage Lakehouses Warehouses and Dataflows Gen2
- Build automated data quality validation frameworks
- Collaborate with AI engineers to prepare feature datasets for ML and LLM use cases
- Configure OneLake shortcuts and mirroring
- Create production grade Power BI dashboards and reports
- Define implement and monitor data quality rules
- Design, build and maintain ETL/ELT pipelines
- Develop Fabric notebooks and Spark job definitions
- Develop and optimize SQL and PySpark transformation logic
- Implement incremental load patterns merge upsert and SCD strategies
- Implement row-level security in Power BI
- Maintain metadata catalogues with ownership lineage and classification
- Publish governed datasets to Power BI service for self service analytics
- Transform raw multi source data into analytics ready datasets
- Triage and resolve data quality incidents
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | CI/CD | Collibra | DAX | DBT | Data Catalog | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Quality | Databricks | Dataflows Gen2 | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Fabric notebooks | Git | Great Expectations | Incremental loading | Lakehouse | Merge Upsert | Microsoft Fabric | OneLake | Power BI | PySpark | Python | Row Level Security | SCD Type-2 | SQL | Semantic Model | Star Schema | Type 2) | Unity Catalog | Warehouse
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Data Engineer (Databricks) (Remote) INR 1500K-2040KAI | API Keys | AWS Glue | AWS IAM | AWS LambdaCollaboration | Ownership culture | Remote workSenior-level Full TimeMaharashtra, Pune, India R2h ago
-
AI / ML Engineer (Remote) INR 2500K-4500KAWS | Amazon SageMaker | CI/CD | Computer Vision | Data PreprocessingRemote workSenior-level Full TimeMaharashtra, Pune, India R2h ago
-
Fullstack Data Engineer (India) INR 1500K-2300KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Remote work | UK shift hoursSenior-level Full TimeMaharashtra, Pune, India3h ago
-
Principal Consultant, Cloud Data Engineer INR 2800K-4000KApache Spark | Azure | Big Data | CI/CD | Data ModelingAI certifications | Mentorship | World-class trainingSenior-level Full TimeIndia-Bangalore3h ago
-
Data Engineer INR 1500K-2000KAgentic AI | Cloud Computing | Cost Optimization | Data Architecture | Data PipelinesMid-level Full TimeIN-MH-Pune3h ago
-
Big Data -Snowflake INR 1200K-2000KBig Data | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeIN-TN-Chennai3h ago
-
Senior-level Full TimePune, Maharashtra, India4h ago
-
Machine Learning Design Engineer, Silicon INR 3400K-5000KASIC design | Area Optimization | Assertion-based Formal Verification | CHISEL | CacheSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Senior-level Full TimePune, India5h ago
-
Analytics Solutions Manager INR 1234K-1748KAccess Control | Anomaly Detection | Artificial Intelligence | CDC | CI/CDMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Software Engineer II INR 1400K-1700KAPI Development | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DBMid-level Full TimeBengaluru, KA, IN6h ago
-
Associate - Data Scientist INR 1800K-2500KAWS | Agent systems | Apache Spark | Azure | Cloud platformMid-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Senior Data Engineer INR 2800K-3500KAPI Development | AWS | Algorithms | Amazon Kinesis | Amazon RedshiftCharity programs | Discounted gym memberships | Environmental initiatives | Flexible working | Life assuranceSenior-level Full TimeHyderabad, India7h ago
-
Lead Assistant Manager INR 1500K-2000KAWS | Apache Airflow | Azure | Data Governance | Data LakehouseSenior-level Full TimeIndia7h ago
-
Data Engineer INR 1500K-2345KAWS | Amazon Kinesis | Amazon Redshift | Azure | BashDiscounted gym memberships | Flexible working | Life assurance | Medical insurance | Pension schemeMid-level Full TimeHyderabad, India8h ago
-
Applied AI/ML Associate Senior - Causal ML INR 1400K-2000KA/B | A/B Testing | Apache Hive | Apache Spark | B testingMid-level Full TimeBengaluru, Karnataka, India8h ago
-
Analytics Solution Associate INR 945K-1496KAI assisted productivity | Alteryx | Anomaly Detection | Artificial Intelligence | Data AnalysisMid-level Full TimeBengaluru, Karnataka, India8h ago
-
Mid-level Full TimeMumbai, Maharashtra, India9h ago
-
Senior-level Full TimeBangalore, KA, IN9h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAPI Integration | Agent Frameworks | Agile | Azure | BERTMid-level Full TimePune, Maharashtra, India9h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAgentic Frameworks | Agile | Azure | BERT | DjangoMid-level Full TimeBangalore, Karnataka, India9h ago
-
Senior_AI_developer INR 3125K-4763KAPI Orchestration | CI/CD | CNN | Computer Vision | Data PreprocessingSenior-level Full Timebangalore, India10h ago
-
Senior Data Engineer INR 2520K-3880KAWS CodePipeline | AWS DMS | AWS Glue | AWS Lambda | Amazon KinesisReward and recognition | Volunteering opportunities | Wellness program | Work-life balanceSenior-level Full TimeHyderabad, India10h ago
-
AI Services | Agentic Workflows | Anthropic | App Service | Azure AICareer growth | Direct product impact | Fully remote work | Startup environment | Technical autonomySenior-level Full TimeIndia R10h ago
-
Lead Software Engineer – Python, Terraform, Snowflake, AWS INR 2000K-4000KAWS | Agile | Amazon Web Services | Application Resiliency | By DesignSenior-level Full TimeHyderabad, Telangana, India11h ago