Senior Software Engineer (Webscraping) Job at Remotereps, San Diego, CA

cHFWQXRFU21VWDZRQkc0UzkrblM2SXppanc9PQ==
  • Remotereps
  • San Diego, CA

Job Description

Technology & Design Full-time 51-200 employees · Staffing & Recruiting Actively recruiting Company Description Based in San Diego, California we are an IT consulting company that uses state-of-the-art software development methodologies to deliver a high standard variety of projects to our valued clients. We specialize in UX/UI Design and Development for Web and Mobile applications. We are a passionate group of designers and engineers with experience in creating applications for VC-funded companies. Required Skillset Docker, AWS, S3, Lambda, PHP, Symfony, Python, Redis, Scrapy Job Description RemoteReps is looking for a technical developer with a diverse range of skills to join our team. The ideal candidate should have expertise in web scraping, proxy technology, and fingerprinting. In addition, the candidate should have intermediate knowledge of distributed computing, Docker, Docker Compose, AWS, S3, IAM, SSH, Lambda, PHP Laravel, Symfony, Artisan, bin/console, Python, Flask, Requests, Puppeteer (pyppeteer), JS Rendering, DOM Traversal, Element Selection, and Headless Chrome. The candidate should be comfortable with RESTful API design best practices, fundamental design patterns, algorithms, unit testing, and automated testing. They should also have knowledge of methods, headers, responses, and debugging, as well as the JSON response data format. Familiarity with Redis and Swagger/OpenAPIV3 Specification is also desired. Responsibilities: Develop and maintain web scraping tools and applications using proxy technology and fingerprinting techniques. Design and implement Docker and Docker Compose environments for distributed computing. Utilize AWS services such as S3, IAM, SSH, and Lambda to create scalable and secure systems. Develop and maintain applications using one or many of bin/console, Go Lang, Python, Flask, Requests, Puppeteer (pyppeteer), JS Rendering, DOM Traversal, Element Selection, and Headless Chrome. Create and maintain RESTful APIs using best practices. Utilize fundamental design patterns and algorithms to build efficient and scalable systems. Write unit tests and automated tests to ensure code quality. Troubleshoot and debug methods, headers, responses, and JSON response data format. Utilize Redis for caching and data storage. Implement Swagger/OpenAPIV3 Specification for API documentation. Qualifications: Expertise in web scraping, proxy technology, and fingerprinting. Intermediate knowledge of distributed computing, Docker, Docker Compose, AWS, S3, IAM, SSH, Lambda, Go Lang, bin/console, Python, Flask, Requests, Puppeteer (pyppeteer), JS Rendering, DOM Traversal, Element Selection, and Headless Chrome. Familiarity with RESTful API design best practices, fundamental design patterns, algorithms, unit testing, and automated testing. Knowledge of methods, headers, responses, and debugging, as well as the JSON response data format. Familiarity with Redis and Swagger/OpenAPIV3 Specification. Strong problem-solving skills. Bachelor's or Master's degree in Computer Science or a related field. #J-18808-Ljbffr Remotereps

Job Tags

Full time,

Similar Jobs

Griswold Home Care For Southeast Dayton, OH

Caregiver Job at Griswold Home Care For Southeast Dayton, OH

Caregiver Griswold Home Care in Dayton is calling all compassionate individuals to apply to join our amazing team as a part-time Caregiver...  ...enjoy working with senior citizens? Can I provide compassionate elderly care with a positive attitude? Am I punctual and dependable? If... 

Comphealth

Physician Family Practice Job at Comphealth

Come live and practice in Great Falls, Montana. The town has markets, concerts, and a charming small-town ambiance. It has hundreds of miles of hiking, biking, running, and snowmobiling trails. There are lakes for kayaking and paddle boarding, and skiing is only a short...

IAP2 Canada

Board Member (Volunteer Position) EN Job at IAP2 Canada

 ...experience in one or more of the following areas: Finance: accounting, financial oversight, budgeting, investment strategy Legal: nonprofit law, contracts, risk management, compliance Governance: board leadership, policy development, bylaws, and nonprofit operations... 

Lang Models

Marketing Summer Internship - unpaid position Job at Lang Models

 ...Job Description Job Description Job Title: Marketing & Social Media Intern Model Agency Location: Hybrid (In-Studio + Remote) Toronto Internship Type: Part-time | Unpaid or Academic Credit | Duration: 36 months About Us: Lang Models is a... 

Regions Bank

L&D Organizational & Leadership Development Business Partner (Regions Footprint) Job at Regions Bank

 ...information by visiting and logging into the careers section of the system.**Job Description:**At Regions, the Learning & Development (L&D) Organizational & Leadership Development Business Partner operates at a strategic level. The position provides consultation on...