Principal Software Engineer
Tasks
- Automate data pipelines for production
- Build data platforms
- Collaborate with data analysts and data scientists
- Conduct code reviews
- Conduct data synchronization
- Design data pipelines
- Develop ETL and ELT workflows
- Develop streaming data solutions
- Document data pipeline architectures
- Ensure data security and integrity
- Implement batch data pipelines
- Implement data integration solutions
- Implement data quality controls
- Lead technical solutions with best practices
- Mentor team members
- Model data structures
- Operationalize data pipelines
- Optimize data processing performance
- Perform data warehousing design
- Perform unit testing
- Translate business requirements to solution architecture
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | AWS Glue | AWS Lambda | Amazon DynamoDB | Amazon EC2 | Amazon RDS | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse Analytics | Batch data | Batch data pipelines | CI/CD | Cloud Dataflow | Cloud Dataproc | DBT | Data Architecture | Data Factory | Data Governance | Data Integrity | Data Lake | Data Modeling | Data Pipelines | Data Security | Data Warehousing | Data mesh | Data orchestration | Data synchronization | Database Design | Datadog | Dimensional Modeling | Docker | ELT | ETL | Git | GitHub Actions | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Dataproc | Grafana | Hadoop | Hive | Informatica | Java | Jenkins | Kafka | Kubernetes | Lakehouse | Python | Relational Database | Relational Database Design | SQL | Snowflake | Streaming Data | Streaming data pipelines | Synapse Analytics | Talend | Terraform | Trino
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior-level Full TimeBangalore, KA, IN5h ago
-
Senior_AI_developer INR 3125K-4763KAPI Orchestration | CI/CD | CNN | Computer Vision | Data PreprocessingSenior-level Full Timebangalore, India5h ago
-
Senior Data Engineer INR 2520K-3880KAWS CodePipeline | AWS DMS | AWS Glue | AWS Lambda | Amazon KinesisReward and recognition | Volunteering opportunities | Wellness program | Work-life balanceSenior-level Full TimeHyderabad, India5h ago
-
AI Services | Agentic Workflows | Anthropic | App Service | Azure AICareer growth | Direct product impact | Fully remote work | Startup environment | Technical autonomySenior-level Full TimeIndia R6h ago
-
Sr. Staff Software Engineer, Machine Learning INR 2500K-4500KC++ | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Deep learningHealth and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India7h ago
-
Software Engineer II - Java Full Stack Developer + AI/ML INR 1400K-2200KAWS | AppDynamics | CI/CD | Curl | DynatraceMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Data Engineer for AZURE cloud Platform INR 1500K-2000KAPIs | Airflow | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBengaluru, KA, India7h ago
-
Generative AI Systems Engineer – Vision-Language Models INR 2500K-4500KAPI Development | Batching | Caching | Containerization | DockerSenior-level Full Timebangalore, India8h ago
-
AI Engineering Lead INR 2500K-5000KAgent systems | Agentic behavior | Amazon Web Services | Azure | CI/CDCollaborative culture | Five-day work week | Flexible working hours | Supportive work environmentSenior-level Full TimeGurugram, Haryana, India9h ago
-
Lead AI Engineer INR 2500K-4500KAI Search | AI Studio | Agent Orchestration | Agent systems | Application InsightsSenior-level Full TimeIND-Bangalore, India12h ago
-
EY - GDS Consulting - AIA -AI Engineer- Senior INR 2000K-4000KAI Search | API | AWS | Agentic AI | AutogenSenior-level Full TimeKolkata, WB, IN, 70009112h ago
-
Apprentice INR 360K-420KAnthropic API | Artificial Intelligence | Langchain | Language Models | Large Language ModelsEntry-level ApprenticeshipNoida, UP, IN, 20130512h ago
-
Senior-level Full TimeAny NTT location, KA, IN12h ago
-
Entry-level Full TimeTRIL INFO PARK, CAMBRIDGE TOWER, India12h ago
-
Bigdata Developer INR 2000K-2755KApache Kafka | Apache Spark | Cloudera | Data Governance | Data PipelinesSenior-level Full TimeTOWER B, EON FREE ZONE II, …12h ago
-
Senior Data Engineer INR 2520K-3356KAWS | Apache Airflow | Apache Iceberg | Apache Spark | AzureEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India16h ago
-
Senior-level Full TimePune, MH, India22h ago
-
Fullstack Data Engineer (Remote) INR 800K-2000KAPI Keys | AWS IAM | AWS S3 | AWS VPC | Apache SparkRemote work | UK shift scheduleSenior-level Full TimeMaharashtra, Pune, India R22h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India22h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India22h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4144KAWS | Agentic AI | Azure | Azure OpenAI | Cloud ComputingSenior-level Full TimeIndia-Pune23h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4725KAWS | Agentic AI | Azure OpenAI | Cloud platform | Deep learningSenior-level Full TimeIndia-Kolkata23h ago
-
Senior DevOps Engineer (AWS | MLOps | Kubernetes) INR 2500K-4000KAWS IAM | Amazon EKS | Amazon S3 | Amazon Web Services | Argo CDHybrid workSenior-level Full TimeMaharashtra, Pune, India23h ago
-
Staff Java Engineer - Full Stack INR 2800K-4000KAWS | Agile | Angular | CI/CD | CucumberReward & recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India23h ago
-
GenAI Azure INR 1800K-2500K.NET | API Management | ASP.Net Core | Access Control | Active DirectoryMid-level Full TimeIN-AP-Hyderabad23h ago