Senior Principal Software Engineer
Tasks
- Architect and implement scalable data pipelines for batch and real time processing
- Collaborate with data scientists analysts and stakeholders to define data requirements
- Deploy and manage cloud-based data solutions
- Ensure data security, compliance, and governance
- Establish best practices coding standards and technical documentation
- Evaluate and recommend new data technologies and tools
- Implement data quality controls and monitoring
- Lead design development and maintenance of data engineering infrastructure
- Mentor and provide technical guidance to data engineers
- Optimize data models and database designs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Amazon S3 | Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure | Batch Processing | Cloud platform | Data Engineering | Data Governance | Data Modeling | Data Monitoring | Data Pipelines | Data Quality | Data Security | Data Warehousing | Database Migration | Database Migration Service | ETL | Google Cloud | Google Cloud Platform | Luigi | NoSQL | Real Time | Real-time Processing | SQL | Server Migration | Server Migration Service | Time processing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Engineer II, Quality Engineering INR 1340K-1890KAPI Testing | AWS | Amazon Redshift | BigQuery | CI/CDContinuous learning | Family-friendly perks | Financial wellness programs | Flexible time off | Health care coverageMid-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …2h ago
-
Mid-level Full TimePune City, India12h ago
-
AI Native Full stack Developer - #2896 INR 1500K-1700K.Net Core | ASP.NET | AWS Lambda | Agile | Amazon EC2Cross-functional collaboration | Mentorship | Technical coachingMid-level Full TimeChennai, India12h ago
-
Data Engineer INR 400K-1200KApache Airflow | CI/CD | DBT | Data Quality | Dimensional ModelingOn-call rotationSenior-level Full TimeIN-KA-Bangalore13h ago
-
Group Manager - Data Engineering INR 1500K-2000KAPI | Authentication | BeautifulSoup | Data Governance | Data QualityMid-level Full TimeBangalore, KA, India13h ago
-
Machine Learning Engineer INR 2500K-3000KC plus plus | C# | Data Modeling | Data Structures | Deep learningMid-level Full TimeHyderabad, India14h ago
-
Associate Business Intelligence Analyst INR 850K-1200KAgile | Classification | Clustering | Data Analysis | Data PreprocessingMid-level Full TimeHyderabad, Telangana, India14h ago
-
Mid-level Full TimeGurgaon, Haryana, India14h ago
-
Linguistic Engineer INR 2200K-3000KBias Mitigation | Conversational AI | Hack | Knowledge graphs | Language ProcessingMid-level Full TimeHyderabad, India14h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPIs | AgentOps | Amazon SageMaker | Apache Airflow | Azure MLMid-level Full TimeBangalore, Karnataka, India14h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPIs | AWS | AWS SageMaker | Airflow | AzureAccess to AI research labs | Access to cloud innovation platforms | Certifications | Opportunity to lead POCsMid-level Full TimeBangalore, Karnataka, India15h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPI Design | AWS SageMaker | Airflow | Azure Machine Learning | CI/CDAccess to AI research labs | Cloud innovation platforms | Professional certificationsMid-level Full TimeBangalore, Karnataka, India15h ago
-
Assistant Manager - Gen AI INR 1000K-1350KAPIs | Amazon SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to certifications | Access to cloud innovation platforms | Work on AI research labsMid-level Full TimeBangalore, Karnataka, India15h ago
-
Mid-level Full TimeBengaluru, Karnataka, India15h ago
-
Entry-level Full TimeIndia15h ago
-
Senior Lead Software Engineer - Java, Spark, Iceberg INR 1800K-2400KAWS Multi Az | AWS Multi Region | Amazon Web Services | Apache Iceberg | Apache SparkAgile team collaboration | Secure stable scalable deliverySenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Senior Software Engineer (C, C++ and embedded Linux.) INR 1500K-2200KAgile | Bash | C# | C++ | Cloud ComputingSenior-level Full TimeHyderabad, TS, India16h ago
-
API Integration | Agile | Alert Correlation | Ansible | ApacheSenior-level Full TimeBengaluru, INDIA, India17h ago
-
Platform Engineering Professional - Data Engineer INR 2800K-4000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Inclusive workplace | Learning opportunitiesMid-level Full TimeBengaluru, IN, 56010318h ago
-
Manager, Data Science and Analytics INR 1500K-2000KClustering | Data Pipelines | Experimentation | Language Processing | Model MonitoringMid-level Full TimeBangalore, India18h ago
-
Staff Data Engineer (Bigdata + Golang/ Java/ Rust/ C/C++) INR 2250K-3500KAmazon Web Services | Azure | C++ | Cloud platform | Data ProcessingHybrid workSenior-level Full TimeBengaluru, INDIA, India19h ago
-
Mid-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Software Engineer, Machine Learning INR 2516K-3380KA/B | A/B Testing | Artificial Intelligence | Attribution Modeling | Auction dynamicsFinancial wellness support | Health benefits | Hybrid work schedule | Mental health support | Paid time offSenior-level Full TimeBengaluru, India22h ago
-
Data Engineer /ETL Lead Sr Technical Lead-Data Engg INR 300K-370KAWS | Ab Initio | Agile | CI/CD | Cost OptimizationSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …1d ago
-
Archiving Squad Data Engineer-Senior INR 2000K-2146KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 2013011d ago