Data/Software Engineer
Boston, Massachusetts; Boston, MA; Boston, MA; Cambridge, Massachusetts; Boston, Massachusetts; Boston, MA
A USD 100K-132K (estimate) Mid-level Full Time
Tasks
- Build Hadoop workflow pipelines
- Build real time bidding and optimization algorithms
- Create regression tests and deployment strategies
- Design scalable data and reporting services
- Develop Hive UDF
- Develop MapReduce jobs
- Develop data distribution and reporting components
- Develop enhancements to Hadoop Hive based data pipelines
- Generate internal and external reports and visualizations
- Implement new services and algorithms to improve product
- Implement streamed data processing services
- Maintain ETL pipelines across multiple data systems
- Monitor and troubleshoot on call systems
- Process billions of events per day
- Support 24x7 production data services
Perks/Benefits
Skills/Tech-stack
AWS | Bourne Shell | Cron | D3 | EMR | ETL | Go | Hadoop | Hive | Java | JavaScript | Linux | MapReduce | MySQL | Oozie | PostgreSQL | Python | R | Redshift | Ruby | SQL | Unix
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
C# | Data Governance | Data Modeling | Data Structures | Data pipeline401k | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2h ago
-
AWS | Artificial Intelligence | Confluence | Data Analysis | Eclipse401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …2h ago
-
Software Engineer 2 - (Python, PySpark, AWS) USD 208K-254KAWS Glue | AWS Lambda | Algorithms | Amazon DynamoDB | Amazon Web Services401k match | Educational assistance | Federal Holidays | Health insurance | PTOSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Software Engineer 1 - (AI, Python, LLM) USD 163K-199KAWS | ArgoCD | CI/CD | Docker | Helm401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2h ago
-
AWS | Argo CD | CI/CD | Docker | Elastic401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …2h ago
-
AWS | Argo CD | CI/CD | Docker | Elastic401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland2h ago
-
Senior Data Engineer (Remote) USD 108K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data VisualizationRemote workSenior-level Full TimeUnited States R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiHybrid work model | Remote work | US government clearanceSenior-level Full TimeAnnapolis Junction, MD; San Antonio, TX R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data EngineeringHybrid work model | Onsite Days Per Week | Remote work option | US government clearance requirementsSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionHybrid work schedule | Onsite work 1 to 2 days per week | Remote work 3 to 4 days per weekSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data pipelineHybrid workSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesHybrid schedule | US government clearance supportSenior-level Full TimeHerndon, VA; San Antonio, TX R2h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data pipeline | ETLHybrid work model | Onsite work 1 to 2 days per week | Remote workSenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesHybrid work model | Remote work flexibilitySenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Data Engineering | ETL | Integration TestingHybrid work model | Onsite Days Per Week | Remote workSenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data PipelinesCoding challenge during interview process | Hybrid work model | US federal security clearance supportSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data Ingestion | Data pipelineHybrid work model | US government clearance sponsorshipSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
AWS S3 | AWS SQS | Data Pipelines | ETL | JavaHybrid work model | Onsite 1 to 2 days per week | Remote work option | US government clearance supportSenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | ETL | Integration TestingHybrid work | US government security clearance supportSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionCoding challenge interview process | Hybrid work | US government security clearance processingSenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data Pipelines | ETLHybrid work model | Onsite 1 to 2 days per week | Remote work daysSenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionHybrid work | Onsite 1 to 2 days per week | Remote workSenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionHybrid work model | Onsite 1 to 2 days per week | Remote work | Secret clearance supportSenior-level Full TimeAnnapolis Junction, MD R2h ago