Software Engineer - Spark, scala, Python, SQL, Databricks
Tasks
- Collaborate with Agile cross-functional teams
- Design scalable data solutions using Apache Spark and Scala
- Develop Python and Scala code for data processing and transformation
- Develop and maintain PostgreSQL databases
- Implement CI/CD pipelines and automated testing
- Implement best practices for code quality and modular development
- Maintain Databricks notebooks jobs and workflows
- Optimize data pipeline performance
- Utilize Git and configuration management tools
- Work with Azure services including ADLS and Key Vault
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | Automated testing | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Key Vault | CI/CD | Data Lake Storage | Data Modeling | DevOps | Git | Key Vault | PostgreSQL | Python | SQL | Scala
Education
Roles
Related jobs
-
Full Stack AI Engineer - 3162 (Remote) INR 2000K-4500K.NET | AI Foundry | Agile | Azure AI | Azure AI FoundryFlexible working hours | Learning and development programs | Remote work | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India R3h ago
-
Mid-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeIN-HR-Gurgaon4h ago
-
AI Developer with Move Framework INR 1800K-2800KAgentic AI | Artificial Intelligence | Chatbot | MCP | MoveworksMid-level Full TimeIN-KA-Bangalore4h ago
-
Senior QA Engineer - GenAI, VoiceAI, Telephony, and IVR testing INR 1800K-3000KAPI Testing | ASR | Automation frameworks | CCaaS | Call Flow TestingSenior-level Full TimeNoida, Uttar Pradesh, India4h ago
-
Mid-level Full TimeBengaluru, Karnataka, India5h ago
-
Elite Software Engineering Pipeline (All Levels) INR 2475K-3500KAWS | Amazon Neptune | Angular | Autogen | Database MigrationHybrid work | Inclusive culture | Structured mentorshipSenior-level Full TimePune, MH, India5h ago
-
3-5 Years Experience in DevOps(MLOps), ML-Python INR 2500K-4225KAngular | DevOps | MLOps | Machine Learning | PythonSenior-level Full Timecoimbatore, India5h ago
-
Senior-level Full TimeBangalore, Karnataka, India6h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2400KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India6h ago
-
Group Manager - Data Engineering INR 1500K-2500KAgile | Apache Airflow | Apache Kafka | BigQuery | CI/CDMid-level Full TimeGurgaon, HR, India6h ago
-
Senior AI/ML Engineer I INR 3000K-4000KAzure | Data Pipelines | Distributed Systems | Docker | Fine TuningCertification programs | Education reimbursement program | Employee assistance program | Flexible work options | Health coverageSenior-level Full TimeBangalore, Karnataka, India6h ago
-
DAX | Data Documentation | Data Governance | Data Quality | Data WarehousingAsync first collaboration | Flexible overlap schedule | Remote workSenior-level Full TimePune, Maharashtra, India7h ago
-
Entry-level Full TimeIndia7h ago
-
Mid-level Full TimePune, ASIA, India8h ago
-
Consultant - Python Developer with Gen AI using GCP INR 2000K-3500KAI Agents | API Development | Cloud platform | Containerization | Gemini EnterpriseWork from client office 5 days per weekSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Senior-level Full TimeCoimbatore, India9h ago
-
Senior Engineer, AI, Quality Assurance INR 1800K-3000KAgile | Artificial Intelligence | CI/CD | Data Quality | Drift DetectionSenior-level Full TimeChennai, IN9h ago
-
Senior-level Full TimeChennai, IN9h ago
-
Analytics Solution- Associate INR 1640K-2461KAgile | Change Data Capture | Continuous Deployment | Continuous integration | Data CaptureSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Mid-level Full TimeHyderabad, TS, India9h ago
-
Senior Engineer, Industrial Engineering INR 2400K-3500KCalculated Fields | DAX | Data Modeling | Data Warehousing | ETLSenior-level Full TimeBengaluru, KA, India9h ago
-
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | Amazon EC2Mid-level Full TimeHyderabad, Telangana, India9h ago
-
Senior-level Full TimeHyderabad, Telangana, India10h ago
-
Data Driven Development for Data/AI/CV based applications INR 2500K-3500KAdversarial Networks | AutoEncoder | Azure Machine Learning | Convolutional Neural Networks | Deep learningAgile work environment | Strong communication cultureSenior-level Full Timebangalore, India10h ago