Principal Data Engineer - Nexus Platform
IND - KA - Bangalore - Outer Ring Road, India
INR 2800K-4000K (estimate) Senior-level Full Time
Tasks
- Architect and prototype ingestion patterns using CDC and API based ingestion
- Build dbt transformation frameworks
- Collaborate with data modeling centers of excellence on Data Vault standards
- Define governed landing strategies on AWS S3 and Lake Formation
- Define orchestration patterns and pipeline standards
- Design data modeling and transformations
- Develop reusable frameworks and templates
- Embed data quality testing frameworks in pipelines
- Evaluate emerging tools for data ingestion integration
- Implement data contracts and testing with DBT
- Integrate data governance with Collibra and BigID
- Lead Data Vault 2.0 raw vault design
- Lead end-to-end POCs
- Optimize Snowflake workloads for performance and cost
- Prototype API based data access with microservices
- Prototype event driven data patterns
- Provide technology recommendations and architecture decisions
- Validate data observability and quality
- Validate pipeline reliability and scalability
Perks/Benefits
- N/A
Skills/Tech-stack
API | AWS | AWS IAM | AWS Lake Formation | AWS Lambda | Airflow | Amazon Fargate | Amazon S3 | Astronomer | BigID | CDC | Collibra | DBT | Data Contracts | Data Modeling | Data Observability | Data Quality | Data Vault | Data Vault 2.0 | Event Driven | Event-driven architecture | Lake Formation | Lakehouse | Microservices | Python | Qlik Replicate | SQL | Snowflake
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Software Engineer INR 1300K-2000KAgile | Cloud services | Code review | Data Modeling | Design PatternsMid-level Full TimePune, India13h ago
-
AWS Agentic AI INR 2000K-4800KAPI Integration | AWS Glue | AWS Lambda | AWS Step Functions | Agentic AISenior-level Full TimeIN-KA-Bangalore17h ago
-
Gen AI INR 2000K-3500KAI Agent | AI Governance | AI agent evaluation | AWS CodePipeline | Agent OrchestrationMid-level Full TimeIN-AP-Hyderabad17h ago
-
Senior Data Engineer INR 3264K-4995KAWS | Agile | DBT | Data Governance | Data ModelingFlexible work options | Life leave days | Professional development days | Retirement savings options | Vacation timeSenior-level Full TimePune, MH, India17h ago
-
Data Engineer INR 1500K-2000KApache Airflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud FunctionsMid-level Full TimeIndia-Telangana-Hyderabad17h ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)17h ago
-
Data Scientist Associate INR 1400K-2400KAnalytics | Artificial Intelligence | Compliance | Data Analysis | Fraud DetectionMid-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)18h ago
-
Mid-level Full TimeGurugram, Haryana, India18h ago
-
Advanced Specialist, Technology Data Analyst INR 2200K-4000KAccess Control | Bash | CI/CD | Cause analysis | Collibra24/7 on-call rotationSenior-level Full TimeChennai, Tamil Nadu, India19h ago
-
Forward Deployed Engineer, Generative AI, GECX, Google Cloud INR 2000K-3500KAPIs | Cloud infrastructure | Cloud platform | Debugging | Full StackAccess to advanced AI portfolio | Collaborative culture | Direct access to engineering and research teams | High travelMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Gen AI - Consultant INR 2000K-4500KAWS SageMaker | Apache Airflow | Apache Spark | Azure Machine Learning | CI/CDSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Azure Cloud Devops Module Lead INR 2200K-3500KAuthentication | Authorization | Azure Monitor | Incident Management | Log AnalyticsSenior-level Full TimeNoida, Uttar Pradesh, India19h ago
-
Alerting | Automated testing | Business Intelligence | CI/CD | Dashboard DevelopmentMid-level Full TimeBangalore, Karnataka, India19h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India20h ago
-
Senior Specialist, Business Data Architecture INR 1500K-2500KAzure Data | Azure Data Factory | CI/CD | Cloud Data | Cloud Data PlatformsSenior-level Full TimePune, MH, India20h ago
-
Software Engineer I INR 1500K-2210KAlgorithms | Amazon Web Services | Cloud platform | Data Structures | Distributed SystemsCareer growth | Comprehensive support for holistic well being | Opportunities to learn new skillsEntry-level Full TimeGurugram, HR, India20h ago
-
Generative AI Engineers INR 1500K-2500KGenerative AI | Language Models | Large Language Models | Machine Learning | Prompt engineeringEntry-level Full TimeBangalore, Karnataka, India20h ago
-
Senior-level Full TimeGurugram, Haryana, India21h ago
-
AI Builder | AWS | Agile | Amazon Redshift | AzureMid-level Full TimeBangalore, Karnataka, India21h ago
-
Senior-level Full TimeBengaluru North, Karnataka, India R21h ago
-
Engineering-L2-Bengaluru-Associate-Systems Engineering INR 2500K-3900K.NET | ASP.NET | Angular | Big Data | C#Senior-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Data Engineer INR 3264K-5012KAWS | Agile | Airflow | Alerting | CSVFlexible work options | Life leave days | Professional development days | Vacation time | Volunteer daysSenior-level Full TimePune, MH, India22h ago
-
Senior Engineer (India Office) INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, Karnataka, India22h ago
-
Semantic Data Engineer INR 3000K-3500KAPI Integration | Apache Airflow | Apache Superset | BigQuery | Cube.devSenior-level Full TimeNoida,Uttar Pradesh,India23h ago