4 jobs in Highbrow Technology Inc
Job Description
Job Title: Domain Expert for Terminal-Bench
Job Description:
We're seeking a highly skilled Domain Expert to join our team in authoring deterministic CLI evaluation tasks for Terminal-Bench. As a Domain Expert, you'll own end-to-end task creation, ensuring precision, determinism, and domain expertise. Your responsibilities will include:
Authoring and packaging complete evaluation tasks with Dockerized environments, deterministic tests, and golden solutions
Validating tasks by confirming model failure and authoring oracle solutions
Calibrating difficulty levels and maintaining clear logs and documentation
Applying domain expertise to design realistic and challenging workflows
Requirements:
Strong Linux/CLI fundamentals and proficiency with Docker/Compose and YAML
Experience writing precise, reproducible pytest test suites
Demonstrated prior experience in the relevant domain
Educational background in the specific domain of expertise (Bachelor's or higher)
Domain-Specific Requirements:
We have openings for the following domains:
Security Expert: Cybersecurity, exploitation, and hardening
UI/UX Optimization Expert: Human-Computer Interaction, design
Scientific Computing Expert: Numerical computing, simulation, HPC workflows
File Operations Expert: Unix pipelines, file transformations
System Administration Expert: Unix job control, system troubleshooting
Games Development Expert: Game logic design, simulation of gameplay mechanics
File System Expert: Filesystem structures, permissions, mounts
Protocol Analysis Expert: Network and protocol analysis
Nice to Have:
Experience in benchmark/task authoring or difficulty calibration
Familiarity with offline/headless validation flows
LM training/model evaluation exposure
Python Developer with FastAPI Experience
Posted today
Job Viewed
Job Description
We are seeking a
Python Developer
with strong expertise in
FastAPI
to join an exciting
Reinforcement Learning (RL) Gym project
.
Requirements
- 3+ years
of professional Python development experience. - Strong knowledge of
FastAPI
(or equivalent frameworks like Flask, Django, but FastAPI required). - Experience with
REST APIs, async programming
, and API lifecycle management. - Solid understanding of
software engineering best practices
(testing, CI/CD, version control, design patterns). - Familiarity with
NumPy, Pandas, and PyTorch/TensorFlow
is a plus. - Good to have
: Exposure to
Reinforcement Learning environments
(OpenAI Gym, Gymnasium, Stable Baselines, or custom environments). - Bachelor's or Master's degree in Computer Science, Engineering, or related field.
Quality Assurance Engineer
Posted today
Job Viewed
Job Description
QA, Integration Testing, Functional Testing
- Document test results, track issues, and ensure timely resolution.
Requirements
- 3–6 years of experience in software quality assurance, with a strong focus on automation.
- Hands-on experience with API testing (Postman, PyTest, or equivalent frameworks).
- Solid knowledge of Python for test automation.
- Understanding of REST APIs, async workflows, and microservices testing.
- Good to have: Exposure to reinforcement learning environments (Gym/Gymnasium) or ML/AI pipelines.
- Strong problem-solving and communication skills.
Job Description
Required Skills:
- Minimum 5+ years of overall experience
- Strong experience with Rust.
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
Nice to Have:
- Previous participation in LLM research or evaluation projects.
- Experience building or testing developer tools or automation agents.