Data/Software Engineer
Boston, Massachusetts; Boston, MA; Boston, MA; Cambridge, Massachusetts; Boston, Massachusetts; Boston, MA
A USD 100K-132K (estimate) Mid-level Full Time
Tasks
- Build Hadoop workflow pipelines
- Build real time bidding and optimization algorithms
- Create regression tests and deployment strategies
- Design scalable data and reporting services
- Develop Hive UDF
- Develop MapReduce jobs
- Develop data distribution and reporting components
- Develop enhancements to Hadoop Hive based data pipelines
- Generate internal and external reports and visualizations
- Implement new services and algorithms to improve product
- Implement streamed data processing services
- Maintain ETL pipelines across multiple data systems
- Monitor and troubleshoot on call systems
- Process billions of events per day
- Support 24x7 production data services
Perks/Benefits
Skills/Tech-stack
AWS | Bourne Shell | Cron | D3 | EMR | ETL | Go | Hadoop | Hive | Java | JavaScript | Linux | MapReduce | MySQL | Oozie | PostgreSQL | Python | R | Redshift | Ruby | SQL | Unix
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Java | MySQL | Oracle | Python | Relational databasesEntry-level Full TimeJohnson City, Tennessee; Offutt Air Force …2h ago
-
C# | Data Governance | Data Modeling | Data Structures | Data pipeline401k | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2h ago
-
Software Engineer 1 - (AI/ML, Terraform, AWS) USD 164K-201KAI machine learning | Amazon Web Services | C++ | Data analytics | Databases401k match | Educational assistance | Healthcare coverage | PTOSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Software Engineer 1 - (Python, JavaScript, AI/ML) USD 163K-199KArtificial Intelligence | CI/CD | Confluence | Docker | Git401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeFort Meade, Maryland2h ago
-
Software Engineer 3 - (Python, LLM, AI) USD 232K-283KAI orchestration | API Integration | Confluence | Data Manipulation | Data Parsing401k employer match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
AWS | Artificial Intelligence | Confluence | Data Analysis | Eclipse401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …2h ago
-
Software Engineer 2 - (Python, PySpark, AWS) USD 208K-254KAWS Glue | AWS Lambda | Algorithms | Amazon DynamoDB | Amazon Web Services401k match | Educational assistance | Federal Holidays | Health insurance | PTOSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 232K-283KAI Agents | Backend Development | Distributed Systems | Docker | Elasticsearch401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Software Engineer 1 - (AI, Python, LLM) USD 163K-199KAWS | ArgoCD | CI/CD | Docker | Helm401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2h ago
-
AWS | Argo CD | CI/CD | Docker | Elastic401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …2h ago
-
AWS | Argo CD | CI/CD | Docker | Elastic401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Anomaly Detection | Clustering | Data Analysis | Data Science | Elasticsearch401k matching | Direct employer 401k contribution | Educational assistance | Federal Holidays | Healthcare coverageSenior-level Full TimeFort Meade, Maryland2h ago
-
Senior Data Engineer (Remote) USD 108K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data VisualizationRemote workSenior-level Full TimeUnited States R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiHybrid work model | Remote work | US government clearanceSenior-level Full TimeAnnapolis Junction, MD; San Antonio, TX R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data EngineeringHybrid work model | Onsite Days Per Week | Remote work option | US government clearance requirementsSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionHybrid work schedule | Onsite work 1 to 2 days per week | Remote work 3 to 4 days per weekSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data pipelineHybrid workSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesHybrid schedule | US government clearance supportSenior-level Full TimeHerndon, VA; San Antonio, TX R3h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data pipeline | ETLHybrid work model | Onsite work 1 to 2 days per week | Remote workSenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesHybrid work model | Remote work flexibilitySenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Data Engineering | ETL | Integration TestingHybrid work model | Onsite Days Per Week | Remote workSenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data PipelinesCoding challenge during interview process | Hybrid work model | US federal security clearance supportSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data Ingestion | Data pipelineHybrid work model | US government clearance sponsorshipSenior-level Full TimeAnnapolis Junction, MD R3h ago