Principal Software Engineer
Tasks
- Architect end-to-end data solutions
- Build batch and real-time data pipelines
- Create data models and lineage
- Deploy and manage cloud-based data solutions
- Design data collection and storage
- Design data ingestion streaming pipelines
- Develop source-to-target mappings
- Drive cloud innovations
- Ensure data security, compliance, and governance
- Establish coding standards and technical documentation
- Evaluate and recommend data technologies and tools
- Guide database and data warehouse migration
- Implement data quality controls
- Implement monitoring systems
- Mentor junior data engineers
- Migrate onprem applications to cloud PaaS
- Optimize data models and database designs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Database | AWS Database Migration Service | AWS DynamoDB | AWS EC2 | AWS Glue | AWS Lambda | AWS RDS | AWS S3 | AWS Simple Storage Service | AWS database migration | Airflow | Amazon Redshift | Amazon Web Services | Apache Hadoop | Apache Hive | Apache Iceberg | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure Fabric | Azure Fabric Data Warehouse | Azure Synapse | Azure Synapse Analytics | Cassandra | DBT | Data Factory | Data Warehouse | Database Migration Service | Docker | Fabric Data Warehouse | Git | GitHub Actions | GitLab CI | Google BigQuery | Google Dataflow | Google Dataproc | Google Fabric Data Warehouse | InfluxDB | Informatica | Java | Jenkins | Kubernetes | MongoDB | MySQL | Oracle | PostgreSQL | Python | SQL | SQL Server | Scala | Simple Storage Service | Snowflake | Storage Service | Synapse Analytics | Talend | TimescaleDB | Trino | Web Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Apache Spark | Caching | Data Quality | Data Validation | DataFrameSenior-level ContractSeri Lingampally, India4h ago
-
Data Engineer - Solution Expert INR 1500K-2700KBigQuery | CI/CD | Cloud Security | Cloud platform | Data ModelingSenior-level Full TimePune, MH, India5h ago
-
Generative AI Application Developers INR 1800K-4500KC++ | Computer Vision | Debugging | Generative AI | JavaSenior-level Full TimePune, Maharashtra, India6h ago
-
Generative AI Application Developers INR 1500K-2500KAI integration | Deep learning | Generative AI | Language Processing | Machine LearningMid-level Full TimePune, Maharashtra, India6h ago
-
Senior-level Full TimeMumbai, India6h ago
-
Senior-level Full TimeMumbai, India6h ago
-
Sr IT Analyst INR 2400K-4200KCRM | Data Governance | Data Quality | Data Warehouse | Data analyticsSenior-level Full TimePune, Maharashtra, India6h ago
-
Design Verification Engineer, PhD, Early Career INR 2500K-6000KAI | AI accelerators | Accelerator architectures | Arithmetic Unit | Bus architectureNone Full TimeBengaluru, Karnataka, India6h ago
-
Module Lead AI/ML INR 2500K-5000KAWS | Apache Airflow | Autogen | Azure | Cloud deploymentInclusive workplaceSenior-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Senior-level Full TimeBengaluru, Karnataka, India8h ago
-
Data Engineer INR 1500K-2500KAPI Integration | Access Control | Apache Airflow | Astronomer | BigQuerySenior-level Full TimeIndia8h ago
-
Software Engineer III - Tableau SRE & Automation INR 2500K-4000KChange Management | DNS | Dynatrace | Firewall | GrafanaSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Senior-level Full TimeHyderabad, IN9h ago
-
Mid-level Full TimeHyderabad, TS, India10h ago
-
Lead / Manager Agentic AI Engineer - Claude Code & Codex INR 2000K-4500KAWS | Asynchronous programming | Autogen | Azure | CI/CDSenior-level Full TimeHyderabad, TS, India10h ago
-
Data Engineer INR 1500K-2200KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN10h ago
-
Senior Data Engineer INR 1500K-2600KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageSenior-level Full TimeHyderabad, IN10h ago
-
Senior-level Full TimeGurgaon, HR, India11h ago
-
Assistant Manager INR 1000K-1800KDashboarding | Data Analysis | Data Visualization | Power BI | SQLMid-level Full TimeGurugram, Haryana, India11h ago
-
Software Engineer II INR 1500K-4000KBest practices | C# | Data Pipelines | Debugging | Distributed SystemsMid-level Full TimeIndia, Karnataka, Bangalore11h ago
-
(Senior) AI Engineer - Data & AI Organisation (all genders) 1 INR 2500K-5000KAPI Development | Amazon Web Services | Apache Spark | CI/CD | DBTSenior-level Full TimeBangalore, Karnataka, IN, 56010011h ago
-
(Senior) Software Engineer (all genders) 1 INR 3600K-4720KAI Safety | AWS | Amazon Web Services | Apache Spark | Automated testingSenior-level Full TimeBangalore, Karnataka, IN, 56010011h ago
-
Software Engr II INR 2500K-4800KAlerting | Azure Data | Azure Data Lake | Azure IoT | Azure IoT EdgeSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Director, Data Engineering & Analytics INR 1500K-6000KApache Airflow | Apache Kafka | Apache Spark | Business Intelligence | DBTOffice first model | Onsite collaborationExecutive-level Full TimeBengaluru, Karnataka, India11h ago
-
AWS | Automated testing | Cloud Native | Compliance | Consent ManagementSenior-level Full TimeHyderabad, Telangana, India11h ago