Senior Principal Software Engineer
Tasks
- Architect and implement scalable data pipelines for batch and real time processing
- Collaborate with data scientists analysts and stakeholders to define data requirements
- Deploy and manage cloud-based data solutions
- Ensure data security, compliance, and governance
- Establish best practices coding standards and technical documentation
- Evaluate and recommend new data technologies and tools
- Implement data quality controls and monitoring
- Lead design development and maintenance of data engineering infrastructure
- Mentor and provide technical guidance to data engineers
- Optimize data models and database designs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Amazon S3 | Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure | Batch Processing | Cloud platform | Data Engineering | Data Governance | Data Modeling | Data Monitoring | Data Pipelines | Data Quality | Data Security | Data Warehousing | Database Migration | Database Migration Service | ETL | Google Cloud | Google Cloud Platform | Luigi | NoSQL | Real Time | Real-time Processing | SQL | Server Migration | Server Migration Service | Time processing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
AWS | Agent systems | Agentic AI | Amazon SageMaker | Autonomous AgentsSenior-level Full TimeBengaluru Millenia, India7h ago
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India7h ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India7h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Azure | CI/CD | Data Augmentation | Data PreprocessingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India7h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India7h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDFlexibility program | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India7h ago
-
Data Engineer INR 1200K-1496KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India14h ago
-
Staff Software Engineer - Semantic Layer INR 3000K-4000KAPI Design | Amazon Redshift | Backwards Compatibility | BigQuery | CompilationSenior-level Full TimeIndia - Remote R15h ago
-
Data Governance Engineer INR 3000K-4200KAI Governance | Access Control | Data Classification | Data Governance | Data Lifecycle ManagementCompetitive leave | Equity | Growth opportunities | Health coverageSenior-level Full TimePune, India16h ago
-
Staff Engineer - Java,Scala,AWS INR 3000K-4000KAWS S3 | Agile | Amazon ECS | Amazon EFS | Amazon EMRFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India18h ago
-
Senior Data Engineer INR 3000K-4000KApache Airflow | Apache Spark | Azure | Azure Databricks | CI/CDSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai18h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai18h ago
-
Senior-level Full TimeIN-TN-Chennai18h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad18h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad18h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad18h ago
-
Senior-level Full TimeIndia19h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India20h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India20h ago
-
Mid-level Full TimeMumbai, Maharashtra, India21h ago
-
Mid-level Full TimePune23h ago
-
Senior Machine Learning Engineer - Gurugram INR 2500K-3500KData Modeling | Data Pipelines | Feature Engineering | Machine Learning | Model EvaluationWork from OfficeSenior-level Full TimeGurgaon (Gurugram), Haryāna, India23h ago
-
Lead Machine Learning Engineer - Gurugram INR 2500K-4000KCloud Platforms | Data Pipelines | Demand forecasting | Feature Engineering | Machine LearningWork from OfficeSenior-level Full TimeGurgaon (Gurugram), Haryāna, India23h ago
-
Manager - Python with Gen AI INR 1800K-3000KAutogen | Claude | CrewAI | Data Pipelines | Event DrivenMid-level Full TimeBangalore, Karnataka, India1d ago