zeroth-order-optimization 开源项目推荐（45 个）

LeCAR-Lab /model-based-diffusion

论文《基于模型的扩散用于轨迹优化》的官方实现。基于模型的扩散（MBD）是一种新型基于扩散的轨迹优化框架，利用动力学模型运行反向去噪过程，生成高质量的轨迹。

Evolutionary-Intelligence /pypop

[JMLR (CCF-A)] PyPop7：一个纯 Python 库，用于基于种群的黒盒优化（BBO），尤其是*大规模*算法变体。在不久的将来，我们将添加基于学习的优化器作为其扩展。[https://jmlr.org/papers/v25/23-0386.html]

liangyuwang /zo2

ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]

max-andr /square-attack

Square Attack: a query-efficient black-box adversarial attack via random search [ECCV 2020]

microprediction /humpday

SOTA Black-box optimization (Python and JS) without the baggage

LeCAR-Lab /CoVO-MPC

Official implementation for the paper "CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Design" accepted by L4DC 2024. CoVO-MPC is an optimal sampling-based MPC algorithm.

ZO-Bench /ZO-LLM

[ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".

pdfo /pdfo

Powell's Derivative-Free Optimization solvers.

OPTML-Group /DeepZero

[ICLR'24]《DeepZero：深度模型训练的零阶优化扩展》 作者：陈奥川*、张义明*、贾景涵、詹姆斯·迪芬德弗、刘建成、康斯坦丁诺斯·帕拉西里斯、张义华、张正、巴维亚·凯尔库拉、刘思佳

as791 /ZOO_Attack_PyTorch

This repository contains the PyTorch implementation of Zeroth Order Optimization Based Adversarial Black Box Attack (https://arxiv.org/abs/1708.03999)

damon-demon /Black-Box-Defense

Robustify Black-Box Models (ICLR'22 - Spotlight)

inikishev /torchzero

Modular optimization library for PyTorch (work-in-progress).

zz1358m /Awesome-Gradient-Free-LLMOpt

A curated collection of evolution strategies and zeroth-order optimization for large language models.

optiprofiler /optiprofiler

Benchmarking optimization solvers.

fouratifares /ECP

Every Call is Precious: Global Optimization of Black-Box Functions with Unknown Lipschitz Constants

caesarcai /ZORO

Zeroth-Order Regularized Optimization (ZORO): Approximately Sparse Gradients and Adaptive Sampling

hassaanhashmi /pd_zdpg_plus

Code for IEEE MLSP 2021 paper titled "Model-Free Learning of Optimal Deterministic Resource Allocations in Wireless Systems via Action-Space Exploration"

caesarcai /SCOBO

SCOBO: Sparsity-aware Comparison Oracle Based Optimization

blockwise-direct-search /bds

Blockwise Direct Search (MATLAB version)

glorgao /NES-HT

Hard-Thresholding Meets Evolution Strategies in Reinforcement Learning