Senior Data Engineer-Batch Processing
500 Salem St, Smithfield RI, United States
USD 97K-185K (estimate) Senior-level Full Time
Tasks
- Analyze existing data solutions
- Automate data workflows with Control M
- Build data pipelines
- Collaborate with cross-functional teams
- Containerize applications with Docker
- Create data models in 3NF
- Deploy infrastructure with Terraform
- Design data models with Star Schema
- Design data solutions
- Develop AWS Batch workloads
- Develop Python data processing
- Identify technical debt
- Implement ETL jobs with Spring Batch
- Implement test-driven development
- Perform SQL performance tuning
- Recommend remediation actions
- Set up CI/CD pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
ANSI SQL | AWS Batch | AWS Identity | AWS Identity and Access Management | Access Management | Agile | Amazon S3 | Amazon Web Services | Bash | CI/CD | CloudFormation | Containerization | Continuous Delivery | Continuous integration | Control-M | Data Modeling | Docker | Identity and Access Management | Java | Jenkins | KSH | Kanban | Oracle | Performance Tuning | Python | SQL | SQL Performance | SQL Performance Tuning | Scrum | Snowflake | Spring Batch | Star Schema | Terraform | Test-Driven | Test-Driven Development | Third Normal Form | Unix Shell | Web Services
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
C++ | CPU | Diffusion Models | GPU | InferenceSenior-level Full TimeMountain View, CA, USA4h ago
-
Machine Learning Engineer III USD 119K-210KData Ingestion | Data Security | Deep learning | Experimental Design | Geospatial DataSenior-level Full TimeMichigan Tech Research Institute (Ann Arbor, …5h ago
-
Database Design | ETL | Excel | Pandas | PythonHands-on learning | Mentorship | Real-world datasetsEntry-level InternshipMcLean, VA, US7h ago
-
AI Engineering Manager for Banking Technology USD 156K-234KAPI Design | Angular | Anthropic | Antigravity | CI/CD401k | Accident insurance | Disability insurance | Life insurance | Medical, dental & vision coverageMid-level Full Time6400 LAS COLINAS BLVD IRVING, United …15h ago
-
Agentic AI | CI/CD | Cloud ML | Cloud ML platforms | Container Orchestration401k | Dental insurance | Employee discount | Health insurance | Life insuranceSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN …15h ago
-
AI Gateways | AWS CDK | Chunking | Context engineering | Cost Tracking401k match | Counseling membership | Flexible time away | Life insurance | Long-term disabilityMid-level Full Time-REMOTE, USA- R16h ago
-
Robotic Hardware Engineer USD 100K-150KAbstraction layers | ArduPilot | Autopilot firmware | C++ | CANMid-level Full TimeFort Walton Beach, Florida, United States18h ago
-
Senior Software Engineer, Data USD 150K-200KAWS Lambda | AWS Step Functions | Airflow | Amazon Athena | Amazon S3401k | Bagel Thursdays | Flexible PTO | Hybrid work | Medical, dental & vision coverageSenior-level Full TimeCharlotte, NC22h ago
-
Senior-level Full TimeCarlsbad, California, United States; Scottsdale, Arizona, …22h ago
-
Agile | Apache Airflow | Artificial Intelligence | Automated testing | BigQueryCollaborative culture | Flexible working hours | Performance evaluations | Professional development opportunities | Remote workSenior-level Full TimeIdaho R23h ago
-
Agile | Apache Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first work environmentSenior-level Full TimeMinnesota R23h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative culture | Professional development | Remote-first flexibilitySenior-level Full TimeColorado R23h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first environmentSenior-level Full TimeColumbia R23h ago
-
Agile | Airflow | Automated testing | BI tools | BigQueryCollaborative company culture | Professional development | Remote-first flexible hoursSenior-level Full TimeIllinois R23h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Professional development opportunities | Remote-first flexible hoursSenior-level Full TimeFlorida R23h ago
-
Agile | Airflow | Automated testing | BI tools | BigQueryCollaborative culture | Flexible working hours | Professional development | Remote-first environmentSenior-level Full TimeCalifornia R23h ago
-
Agile | Apache Airflow | Automated testing | BigQuery | CI/CDCollaborative company culture | Professional development opportunities | Remote-first flexibilitySenior-level Full TimeConnecticut R23h ago
-
Agile | Airflow | BI tools | BigQuery | CI/CDCollaborative & Innovative Culture | Professional development | Remote-first flexible hoursSenior-level Full TimeArizona R23h ago
-
Apache Airflow | Apache Hive | Apache Iceberg | Apache Kafka | Apache SparkFully remote work option | International hiring | Long term contractor optionEntry-level Full TimeUnited States R1d ago
-
Database Engineer (U.S. Intelligence Community) USD 149K-220KAWS | Access Control | Ansible | Apache Spark | Azure401k employer match | Dental insurance | Employee stock ownership plan (ESOP) | Employer paid disability | Flexible PTOSenior-level Full TimeFort George G Meade, MD1d ago
-
Data Engineer USD 140K-150KAWS | Alerting | Azure | Azure DevOps | CI/CD401k | Dental insurance | Financial planning assistance | Health insurance | Mental health counselingMid-level Full TimeChamblee, GA, United States1d ago
-
Cloud Engineer/Software Developer USD 135K-206KAWS | AWS SageMaker | CI/CD | CloudFormation | CloudWatchCompany-sponsored events | Flexible work environment | Matching 401k | On-call support | Paid life and disabilityMid-level Full TimeSt. Louis, MO1d ago
-
Embedded Software Engineer – BMS USD 150K-241KAgile | C# | CAN | Circuit Schematics | Communication ProtocolsComprehensive health insurance | Equity compensation | Flexible paid time offSenior-level Full TimeOklahoma City, Oklahoma, United States1d ago
-
Staff Data Engineer USD 200K-250KAirflow | Anomaly Detection | Automated Monitoring | CI/CD | Change Data CaptureAccess to industry-leading technology | FSA option | Flexible paid time off | Fully covered healthcare | One Medical accessSenior-level Full TimeSan Francisco1d ago
-
Senior/Staff Linux Software Engineer – Robotics Platform USD 185K-225KC++ | Computer Vision | Deep learning | FPGA | Linux401k match | Career development | Equity | Health benefitsSenior-level Full TimeBurlingame, California, United States1d ago