Senior Data Engineer (Apache Spark, NiFi, SQL)
O'Fallon, Missouri (Main Campus), United States
USD 140K-231K Senior-level Full Time
Tasks
- Automate data access workflows
- Build data ingestion and movement workflows
- Collaborate with business stakeholders
- Conduct proof of concept for new solutions
- Develop scalable data pipelines
- Enforce software development standards
- Implement mitigation for production incidents
- Perform independent production incident tasks
Perks/Benefits
Skills/Tech-stack
Apache NiFi | Apache Spark | Hadoop | Java | Netezza | Object storage | Oracle | Python | SQL | Scala
Education
N/A
Roles
Related jobs
-
Senior Data Engineer TS/SCI Clearance USD 160K-220KAWS | Cloud Native | Data Visualization | Database Design | Database performanceBest place to work recognition | Employee development | Full employee approach | High employee morale and retentionSenior-level Full TimeHuntsville, United States5h ago
-
Data Engineer USD 148K-263KAPI | Apache Kafka | Apache Spark | Cassandra | Distributed SystemsDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceMid-level Full TimeUSA-Remote Work R5h ago
-
Data cleaning | Data collection | Deep learning | Machine Learning | Model EvaluationSenior-level Full TimeSan Jose, California, United States5h ago
-
GenAI Engineer USD 93K-163KAWS Bedrock | Agentic Workflows | C++ | CI/CD | CohereHealth and wellness benefits | Mentorship | Professional developmentEntry-level Full TimeArlington/Rosslyn, Virginia, United States5h ago
-
Senior GenAI Engineer USD 102K-171KAPI Development | AWS Bedrock | Agentic Workflows | CI/CD | CohereSenior-level Full TimeArlington/Rosslyn, Virginia, United States5h ago
-
Data Scientist - Platform Infrastructure USD 127K-189KData Governance | Data Modeling | Data Pipelines | Data Quality | ETLMid-level Full TimeLos Angeles, California, United States6h ago
-
C++ | Data Compression | Data Ingestion | Data Processing | Data StorageSenior-level Full TimeSan Jose, California, United States6h ago
-
Computer Vision | Data Pipelines | Language Models | Language Processing | Large Language ModelsSenior-level Full TimeBellevue, WA | Menlo Park, CA6h ago
-
Senior Software Engineer, Cloud Databases USD 174K-252KAnalytical processing | Benchmarking | C++ | Cloud Databases | Cloud platformSenior-level Full TimeKirkland, WA, USA7h ago
-
SOC Architect, XProf USD 147K-211KC# | C++ | Compiler profiling | Data Analysis | Data VisualizationSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Data Engineer, Global Business and Operations USD 130K-187KBigQuery | Data Governance | Data Marts | Data Modeling | Data PipelinesMid-level Full TimeNew York, NY, USA7h ago
-
Data Engineer USD 110K-110KAutomated testing | Data Architecture | Data Modeling | Data Security | Data VisualizationMid-level Full TimeAnnapolis, MD, US9h ago
-
Sr. Machine Learning Engineer USD 91K-177KAlgorithms | Anomaly Detection | Apache Airflow | Data Analysis | Deep learning401k plan | Employee recognition | Employee stock purchase plan | Health insurance | Paid time offSenior-level Full TimeIrvine, CA, US9h ago
-
Staff Software Engineer - Core Ingest USD 191K-224KAgile Development | Apache Kafka | Distributed Systems | Docker | Fault ToleranceHealth insurance | Paid time off | Remote work optionsSenior-level Full TimeUnited States, Remote R14h ago
-
Staff Software Engineer - Data Query USD 191K-224KAgile | Automated testing | Big Data | C++ | Data StructuresSenior-level Full TimeUnited States, Remote R14h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeFayetteville, North Carolina, United States16h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | TS/SCI clearance | Vision insuranceSenior-level Full TimeSneads Ferry, North Carolina, United States16h ago
-
Data Engineer - Mid-Level USD 130K-160KAirflow | Automated Deployment | Automated testing | CI/CD | Control workflows401k matching | Dental insurance | Health insurance | Lunch and snacks provided | Maternity & paternity leaveMid-level Full TimeEl Segundo, California, United States17h ago
-
Software Engineer – Surgical Robot Manufacturing USD 127K-192KAutomated testing | Control Systems | HTML | JSON | JavaScriptMid-level Full TimeSunnyvale, CA, United States17h ago
-
Senior Manufacturing Analytics Engineer USD 115K-140KChemometrics | Data Preparation | Descriptive Analytics | Feature Engineering | Machine LearningComprehensive benefits | Medical benefits | Sick leave | Travel up to 15 percentSenior-level Full TimeWayzata, Minnesota, US United States, 5539118h ago
-
Senior Data Engineer - Logistics USD 38K-38KBig Data | Cloud Computing | Cloud Cost Optimization | Column-Level Security | Cost Optimization401k plan | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeSpringdale, AR Terminal Office - Springdale, …18h ago
-
Data Engineer USD 127K-170KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCareer advancement | Flexible work environment | Professional development | Recognition | Work-life balanceSenior-level Full TimeTampa, FL, USA, United States18h ago
-
Data Reliability Engineer USD 87K-123KAWS | Alerting | Amazon DynamoDB | Amazon EMR | Amazon Kinesis401k matching | Dental insurance | Employee resource groups | Flexible work environment | Health insuranceMid-level Full TimeKS Overland Park, United States18h ago
-
Big Data | Cloud Cost Optimization | Cost Optimization | Data Architecture | Data Governance401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …18h ago
-
Quantum Network Manager USD 130K-155KC# | C++ | Cisco | Computer Networking | Fiber opticsHealth benefits | Paid time off | Retirement benefitsMid-level Full TimeHyde Park Campus, United States18h ago