Software Engineer - Spark, scala, Python, SQL, Databricks
Tasks
- Build and optimize data pipelines and analytical solutions
- Collaborate with cross-functional agile teams
- Design develop and maintain PostgreSQL databases
- Design scalable data solutions using Apache Spark and Scala on Azure Databricks
- Develop and maintain Databricks notebooks jobs and workflows
- Develop production-grade Python and Scala code for data processing
- Implement code quality and performance tuning best practices
- Integrate Azure services using ADLS and Key Vault
- Use Git for version control and configuration management
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | Automated testing | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Key Vault | Big Data | Big data processing | CI/CD | Data Lake Storage | Data Modeling | Data Processing | DevOps | Distributed Systems | Git | Key Vault | PostgreSQL | Python | SQL | Scala
Education
Roles
Related jobs
-
Python AI Engineer INR 1800K-3500KAPI Development | AWS | AWS Lambda | Amazon Bedrock | Amazon SageMakerHybrid workSenior-level Full TimeIndia1h ago
-
Software Engineering INR 1400K-1820KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeHyderabad, TS, IN4h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2000K-3630KAWS | Apache Spark | Azure | C++ | Convolutional Neural NetworksSenior-level Full Timebengaluru, India5h ago
-
Senior Staff Machine Learning Engineer (Java + LLM) INR 2500K-3500KAlgorithms | Design Patterns | Java | Machine Learning | Object-OrientedSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Associate Engineer - Agentic AI Developer INR 2000K-3000KAgent systems | Azure | CI/CD | Docker | FastAPIMid-level Full TimeMumbai, MH, India7h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3000KAnthropic | Azure OpenAI | CI/CD | Code Analysis | CypressMid-level Full TimePune, Maharashtra, India7h ago
-
Azure | CSV | ETL | Python | SQLSenior-level Full TimeBangalore, India8h ago
-
FinOps Data Engineer INR 2000K-3000KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India10h ago
-
Senior Data Engineer INR 1500K-2500KApache Airflow | Apache Hive | Apache Oozie | Apache Spark | BigQueryAdditional voluntary benefits | Disability programs | Flexible working hours | Life insurance | Private medical careSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India13h ago
-
GenAI Support Lead - Manager INR 2000K-3465KAI Agents | AI Governance | API Testing | Bias detection | CI/CDEmployee networks | Hybrid work model | Paid volunteer daysSenior-level Full TimeHyderabad, India13h ago
-
Principal QA Engineer – GenAI Testing - Manager INR 1500K-2500KAI Governance | Adversarial Testing | Artificial Intelligence | BDD | Bias detectionFlexible work/life support | Hybrid work model | Paid volunteer daysSenior-level Full TimeHyderabad, India13h ago
-
Generative AI Quality Engineer - Senior Associate INR 1500K-2600KArtificial Intelligence | BDD | CI/CD | Gherkin | GitEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India13h ago
-
Generative AI Quality Engineer - Senior Associate INR 1500K-2600KArtificial Intelligence | BDD | CI/CD | Fiddler | GherkinEmployee networks | Flexible work/life support | Hybrid work model | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
Mid-level Full TimeMumbai, India13h ago
-
Automation and AI Solutions Lead INR 2500K-3500KAWS Bedrock | Agent systems | Amazon AgentCore | Async Programming | CI/CDFlexible vacation | Headspace access | Hybrid work | Mental health days | Retirement savingsSenior-level Full TimeIndia, Bengaluru, Karnataka R13h ago
-
Senior Lead Data Engineer (Snowflake, DBT, Python)- 8 to 13 Years- Chennai & Bangalore INR 2755K-4000KApache Airflow | DBT | Data Modeling | Data Pipelines | ELTCollaboration and respect | Flexible work environment | International work environment | Personal development opportunities | Wellbeing benefitsSenior-level Full TimeIND CHNN 32 A&B 3FL STE …13h ago
-
Senior Lead Engineer (Embedded Platform Software) INR 1500K-2372KARM | Binary Analysis | Board Support | Board Support Package | BootloaderBackground check | Car lease program | Drug screen | Group health insurance | Group personal accident insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …13h ago
-
Senior Software Engineer INR 2139K-3500K.Net Framework | Agile | Asynchronous programming | Azure DevOps | C#Senior-level Full TimeIND Bangalore C 601, India13h ago
-
Sr Software Engineer III (IND) INR 2500K-4763KAutogen | CI/CD | Concurrency | CrewAI | Hugging FaceSenior-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India13h ago
-
Entry-level Full TimeIndia - Bangalore - 5th floor, …13h ago
-
Entry-level Full TimeBengaluru18h ago
-
Snowflake + Aws + dbt + sql Deputy Manager- DE INR 1500K-2000KAgile | CI/CD | DBT | Data Modeling | SQLAnnual appraisal | Free HMO coverage | Paid leaves | Safe work environment | Skills training opportunitiesMid-level Full TimeBengaluru, KA, India20h ago
-
Infrastructure & DevOps Engineer - AWS SageMaker Unified Studio INR 2000K-4000KAWS CloudFormation | AWS CloudWatch | AWS IAM | AWS Lambda | AWS SageMakerRemote workSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Entry-level Full TimePune, Maharashtra, India1d ago