Software Engineer II
Tasks
- Build and optimize ETL/ELT workflows
- Communicate solution design to business partners
- Design develop and maintain batch and real time data pipelines
- Develop reusable data ingestion frameworks
- Drive consistent development practices using common components
- Drive user story analysis and elaboration
- Identify opportunities for adopting new technology
- Implement and optimize data models in BigQuery
- Implement data validation logging and alerting
- Monitor and troubleshoot data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alerting | Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | Continuous Delivery | Continuous integration | DAX | Data Modeling | Data Validation | Data pipeline | Dataflow | Dataproc | ELT | ETL | File Transfer | Git | Google Cloud | Google Cloud Platform | Hive | Jenkins | Logging | Maven | Power BI | Power Query | PubSub | SQL | Scala | Secure File Transfer | Snowflake Schema | Star Schema
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Data Engineer | Engineer | Engineer II | Software Engineer | Software Engineer II
Related jobs
-
Data Architect INR 1500K-2400KAWS Glue | Amazon S3 | Apache Spark | Asset bundles | Azure ADFCareer progression | Health & wellness benefits | Hybrid working | Retirement benefits | Training budget for Databricks certificationSenior-level Full TimePune, India1h ago
-
Senior-level Full TimeIN-TN-Chennai2h ago
-
Senior-level Full TimeIN-AP-Hyderabad2h ago
-
Senior-level Full TimeIN-AP-Hyderabad2h ago
-
Senior-level Full TimeIndia3h ago
-
Agentic AI | As-a-Service | Audit Logging | Cloud Networking | Distributed tracingConference participation | Customer facing technical collaboration | Travel opportunitiesSenior-level Full TimeMumbai, Maharashtra, India3h ago
-
Data and Analytics Lead, Google Cloud INR 1500K-3000KBigQuery | Cloud Migration | Data Modeling | Data Transformation | Database ManagementSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India4h ago
-
Partner Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-4000KAPIs | Agent systems | Artificial Intelligence | Cloud platform | Data PipelinesSenior-level Full TimeMumbai, Maharashtra, India4h ago
-
Senior-level Full TimeBengaluru, Karnataka, India4h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2500KAWS Glue | AWS Lambda | Airflow | Amazon Athena | Amazon EC2Mid-level Full TimeBangalore, Karnataka, India5h ago
-
Senior-level Full TimeBengaluru, Karnataka, India5h ago
-
Senior Expert INR 3000K-3880KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India5h ago
-
Senior Data Engineer INR 2000K-3000KAPI Design | Apache Kafka | Apache Spark | Automated testing | CI/CDSenior-level Full TimeBengaluru, KA, India6h ago
-
Senior Software Engineer 7+ years (Must have- Python, FastAPI (or Flask/Django), Langchain, Mongodb, RestAPI) INR 1960K-2829KAnthropic | Azure OpenAI | CI/CD | Cohere | DjangoEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India6h ago
-
Expert, Analytics Engineering INR 2520K-3880KAWS | Airflow | CI/CD | Cognitive Computing | DBTRelocation assistanceSenior-level Full TimeMumbai, MH, IN7h ago
-
Associate Process Manager INR 800K-1800KBigQueryML | CRM Analytics | Customer Segmentation | Dashboarding | Data ModelingAPAC shift workMid-level Full TimeMumbai, Maharashtra, India7h ago
-
AWS | Alerting | Audit Logging | Azure | CI/CDWork from OfficeSenior-level Full TimePune, MH, India7h ago
-
Senior Software Engineer I INR 2500K-3500KAPI Design | Agile Development | Airflow | Alerting | Apache SparkCareer growth opportunities | Health and wellness support | Learning opportunities | Mentoring opportunitiesSenior-level Full TimeChennai, TN, India9h ago
-
KGS - AWS DevOps - Consultant - Bangalore INR 2125K-3500KAWS | Alerting | Ansible | Artifactory | BitbucketSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior Data Engineer - Privacy INR 2800K-4000KAWS | Apache Airflow | Apache Spark | CCPA | Data ModelingCommuter benefits | Financial wellness support | Hybrid work flexibility | Mental health support | Retirement planSenior-level Full TimeBengaluru, India11h ago
-
Sr Software Engineer INR 2500K-4500KAWS | Apache Iceberg | CI/CD | Data Structures | DockerAgile team environment | Cross-functional team projects | Learning courses and training | Personal development supportSenior-level Full TimeMumbai, India11h ago
-
Sr Software Engineer INR 2800K-4000KAWS Glue | AWS Lambda | Amazon RDS | Amazon S3 | CachingTraining and coursesSenior-level Full TimeMumbai, India11h ago
-
Senior Systems Operations Engineer - Database, SQL, R, Bigdata, Data Lake, Teradata and ETL INR 2000K-2386KAgile | AppDynamics | BCP | Data Lake | DatabaseOn-call support | Shift work | Vendor collaborationSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …15h ago
-
Automation | Autosys | Data Analysis | Gen AI | GrafanaMid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India15h ago
-
Lead Software Engineer - Salesforce development, nCino, Apex, LWC, SOQL, Unit Testing, Agile, Gen AI INR 1800K-3000KAccelQ | Agile | Data Modeling | Design Patterns | GitHubSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …15h ago