Big Data Lead
United States
USD 120K-145K (estimate) Senior-level Full Time Found 1d ago
Tasks
- Build data pipelines using Azure Databricks
- Convert Scala programs to PySpark
- Develop data workflows with Azure Data Factory
- Develop with pyspark
- Implement analytics in Synapse SQL pool
- Manage data lake storage with Azure Data Lake Gen 2
- Transform data in Azure Databricks
- Understand Scala programs in Databricks
- Work with Delta Lake
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen 2 | Azure Databricks | Data Factory | Data Lake Gen 2 | Delta Lake | PySpark | Python | Scala | Spark | Synapse Analytics
Education
N/A
Roles
Language: en |
Views: 0 |
Clicks: 0
Related jobs
-
Active Learning | Contrastive Learning | Deep learning | Diffusion Models | Machine LearningSenior-level Full TimeSan Jose, California, United States14h ago
-
Data Analysis | Knowledge graphs | Language Processing | Machine Learning | Natural LanguageEntry-level Full TimeSan Jose, California, United States15h ago
-
Data Analysis | Knowledge graphs | Language Processing | Machine Learning | Natural LanguageEntry-level Full TimeSeattle, Washington, United States15h ago
-
Data Pipelines | Distributed Computing | Machine Learning | PyTorch | PythonMid-level Full TimeSan Jose, California, United States15h ago
-
AI Engineer (Python, LLM APIs, Cloud Infra) - USA Remote USD 150K-200KCloud infrastructure | LLM APIs | PydanticAI | Python | Relational databasesFlexible schedule | Remote workMid-level Contract Full TimeUSA, United States R15h ago
-
Blackbelt Engineer, Gemini Cloud Assist USD 177K-263KArtificial Intelligence | Caffe | Cloud Architecture | Data Pipelines | Data analyticsBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA16h ago
-
Field Solutions Architect, Google Cloud, Applied AI USD 123K-176KAI | APIs | Cloud Computing | Conversational AI | KubernetesFlexible work hours | Health insurance | Paid travel | Professional developmentSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …16h ago
-
Senior Software Engineer, AI/ML, Google Cloud USD 166K-244KAlgorithms | C++ | Data Processing | Data Structures | Deep learningFlexible work hours | Health insurance | Professional development | Retirement plansSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Software Engineer, AI Enablement USD 150K-350KAI coding | AI coding agent tools | Agent Frameworks | Agent tools | AnthropicDental insurance | Generous PTO | Health insurance | Retirement plan | Vision insuranceMid-level Full TimeSan Francisco, CA21h ago
-
Attention Models | BERT | Deep learning | Digital Signal Processing | GANsRemote workSenior-level Part TimeUnited States - Remote R1d ago
-
Staff ML Engineer, Inference Platform USD 195K-298KC++ | Cloud Platforms | Distributed Systems | Go | Hardware accelerationHealth benefits | Paid vacation | Relocation assistance | Retirement planSenior-level Full TimeGM Automation - Sunnyvale - GM …1d ago
-
Machine Learning / Reinforcement Learning Engineer USD 200K-300KDeep learning | Neural Networks | PyTorch | Python | Reinforcement LearningCollaborative office | Equity | Flexible work environment | Professional growth opportunitiesMid-level Full TimeLos Angeles, California, United States1d ago
-
Senior Software Engineer USD 84K-179KAWS | Apache Kafka | AppDynamics | Big Data | ConfluentCareer growth opportunities | Hybrid workSenior-level Full Time102073-AZ-Building 2222, Rose Garden Ln, Phoenix, …1d ago
-
Data Analysis | Deep learning | Generative AI | Hugging Face | Language ModelsMid-level Full TimeDallas, Texas, United States1d ago
-
AI Engineer - FDE (Forward Deployed Engineer) USD 180K-248KAWS | Azure | Data Science | Dspy | GCPHealth benefits | Professional development | Remote workSenior-level Full TimeUnited States1d ago
-
Data Engineer USD 81K-141KAPI frameworks | Cloud Platforms | Data Analysis | Data Warehousing | ELK StackCollaborative environment | Flexible work hours | Professional development opportunitiesMid-level Full TimeUSA - Remote R1d ago
-
Scientific Data Engineer USD 100K-160KData Analysis | Data Engineering | Data Manipulation | ETL Pipelines | Python401k with employer contribution | Dental insurance | Health insurance | PTOMid-level Full TimeSan Francisco, New York1d ago
-
Senior Data Engineer USD 150K-180KAWS | Airflow | Apache Flink | Apache Kafka | BigQueryFlexible hours | Health insurance | PTO | Paid Holidays | Paid parental leaveSenior-level Full TimeLos Angeles1d ago
-
Senior Data Engineer USD 160KBig Data | Big data architecture | Data Architecture | Data Governance | Data ModelingFlexible work arrangements | Health insurance | Paid time offSenior-level Full TimeTwinsburg, OH, United States1d ago
-
Machine Learning Operations Engineer USD 162K-219KAWS | CI/CD | Data labeling | Data labeling platforms | GoCollaborative work culture | Dental insurance | Health insurance | Professional growth opportunities | Vision insuranceMid-level Full TimeBoston, Massachusetts1d ago
-
Senior Machine Learning Engineer USD 120K-200KData Annotation | Data representation | Language Processing | Machine Learning | Model DeploymentSenior-level Full TimePittsburgh, PA1d ago
-
Senior-level Full TimeSan Carlos, California, United States1d ago
-
Data Infrastructure Engineer USD 170K-247KAWS GCP Azure | Batch Processing | CI/CD | Cloud Environments | Cloud Environments (AWSDeep collaboration | Equity | Medical/dental/vision/401k | Onsite cultureSenior-level Full TimeSan Mateo, CA1d ago
-
BigQuery | Cloud Storage | Data Governance | Data Modeling | DatabricksHealth insurance | Paid time off | Retirement plansMid-level Full TimeNashville, TN, US2d ago
-
Associate Data Engineer - Databricks & GCP USD 60K-111KBigQuery | CI/CD | Cloud Storage | Databricks | DataflowLife & disability insurance | Medical/Dental/Vision | Paid time off | Retirement plansMid-level Full TimeNashville, TN, US2d ago