Data Engineer III 4P/598
Tasks
- Build Azure data lake pipelines
- Build and maintain Databricks pipelines
- Create and manage Azure Data Factory workflows
- Deploy and manage Azure Databricks pipelines
- Design and implement data models
- Design scalable data pipelines
- Develop Spark Hive and Hadoop solutions
- Develop batch and real-time data processing solutions
- Ensure data governance and reliability
- Implement CI/CD pipelines for data deployments
- Implement data quality frameworks
- Integrate APIs and web services
- Integrate and enrich multiple data sources
- Normalize databases and design schemas
- Optimize data access and storage
- Transform raw data into analytics-ready datasets
- Use Docker and OpenShift for containerization
- Work in agile development environments
Perks/Benefits
- N/A
Skills/Tech-stack
API | Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure Key Vault | Azure Synapse | CI/CD | Data Factory | Data Lake | Data Modeling | Docker | Golden Gate | Hadoop | Hive | Informatica | Key Vault | MSBI | OpenShift | Oracle Golden | Oracle Golden Gate | Power BI | Python | R | SQL | SSAS | SSIS | Spark | Web Services
Education
N/A
Roles
Related jobs
-
Robotics Application Engineer USD 100K-300KAutonomous Systems | C++ | Computer Vision | Machine Learning | PythonMid-level Full TimePittsburgh, San Mateo1h ago
-
Machine Learning Intern USD 80K-90KAWS | Apache Hive | Apache Spark | C++ | Cloud platformFinal evaluation | Mentorship | Performance feedbackEntry-level InternshipMountain View, USA6h ago
-
Forward Deployment AI Engineer USD 120K-150KAgent Orchestration | Autogen | Automation | Cloud services | Data extractionClient site travel | Client-facing role | Hybrid workMid-level Full TimeCleveland, OH or Columbus, OH6h ago
-
AWS | Data Governance | Data Lineage | Data Modeling | Data PipelinesMid-level Full TimeHawthorne, California, USA7h ago
-
AI Engineer USD 120K-158KAI Services | AIOps | Azure | Azure AI | Azure AI Services401k match | Dental insurance | Holidays | Medical insurance | Paid time offMid-level Full TimeLos Angeles, CA, USA7h ago
-
Senior Machine Learning Engineer, GenAI Data USD 243K-295KAmazon S3 | Batch Processing | C plus plus | Data Pipelines | Data PreprocessingSenior-level Full TimeSan Mateo, CA, United States R7h ago
-
Staff AI Engineer USD 150K-185KAPI Design | API Gateway | API Integration | AWS Lambda | AWS SQSRemote work | Travel opportunitiesSenior-level Full TimeUnited States9h ago
-
Application/Agentic AI Engineer USD 124K-166KAPI Integration | Agentic AI | CI/CD | DevSecOps | Development LifecycleMid-level Full TimeAberdeen, Maryland10h ago
-
Edge AI/Model Optimization Engineer USD 115K-175KBatching | Benchmarking | CUDA | Caching | ContainersMid-level Full TimeAberdeen, Maryland10h ago
-
AI Engineer (Research & Development) USD 148K-225KAI Platform | AWS SageMaker | Autogen | Azure Machine Learning | CrewAIAdditional PTO | Nutritionist support | Paid medical/dental/vision | Paid time off | Workout lunchesSenior-level Full TimeRaleigh, NC10h ago
-
Staff AI Engineer USD 135K-180KAPI Gateway | API Integration | AWS Lambda | AWS Step Functions | Agent OrchestrationSenior-level Full TimeNewark, NJ10h ago
-
Tech Lead Manager, Data Engineer USD 251K-310KBigQuery | C++ | Data Governance | Data Lake | Data ModelingBonus program | Company benefits program | Equity incentive plan | Hybrid work scheduleSenior-level Full TimeMountain View, CA10h ago
-
Senior Staff Data Engineer - Platform Data and Analytics USD 268K-368KAWS | Airflow | Alerting | Apache Spark | Compute OptimizationComprehensive benefits | Equity | Hybrid/Remote flexibilitySenior-level Full TimeSan Francisco, CA R11h ago
-
Consultant, Data Analytics USD 90K-110KAlteryx | Azure Data | Azure Data Factory | Boomi | CI/CD401k match | ADandD insurance | Charitable donation match | Childcare Account | Commuter accountMid-level Full TimeDurham, North Carolina11h ago
-
Consultant, Data Analytics USD 90K-110KCI/CD | Data Engineering | Data Monitoring | Data Visualization | Data Warehouse401-k match | Charitable donation match | Childcare Accounts | Commuter benefits | Dental insuranceMid-level Full TimeEmeryville, California12h ago
-
Consultant, Data Analytics USD 90K-110KAzure Data | Azure Data Factory | CI/CD | Data Factory | Data Modeling401k matching | Dental insurance | Disability insurance | Flexible-hybrid work | Health insuranceMid-level Full TimeBoston, Massachusetts12h ago
-
Consultant, Data Analytics USD 90K-110KAlteryx | Azure Data | Azure Data Factory | CI/CD | Data Engineering401k match | AD and D insurance | Charitable donation match | Childcare Accounts | Commuter benefitsMid-level Full TimeRockville, Maryland12h ago
-
Consultant, Data Analytics USD 90K-110KAlteryx | Azure Data | Azure Data Factory | CI/CD | ChatGPT401k match | Charitable donation match | Childcare Accounts | Commuter benefits | Disability insuranceMid-level Full TimeSan Diego, California12h ago
-
Senior AI Engineer USD 95K-197KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy | Learning and development programs | MentorshipSenior-level Full TimeChicago, Illinois, USA; Los Angeles, California, … R13h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeChicago, Illinois, USA; San Francisco, California, … R13h ago
-
Apache Hive | Apache Iceberg | Apache Kafka | Authentication | AuthorizationSenior-level Contract Full TimeCincinnati, Ohio, United States13h ago
-
Senior AI Engineer USD 131K-195KAmazon Comprehend | Amazon SageMaker | Anomaly Detection | Chatbots | ElasticsearchSenior-level Full TimeFalls Church, VA, United States14h ago
-
Senior-level Full TimeAuburn Hills, MI, United States15h ago
-
Benchmarking | C++ | Computer Vision | Evaluation metrics | Eye-trackingContract position | Hybrid work scheduleEntry-level Contract Full TimeBurlington, MA, United States15h ago
-
Data Scientist (Graph analysis) USD 135K-185KCypher | Data Ingestion | Data Processing | Docker | ETLOn-site workMid-level Full TimeColumbia, MD, United States15h ago