FLUX.1 Depth

Про Black Forest Labs

Засновано 2024 · Freiburg, Germany

Black Forest Labs was founded in August 2024 in Freiburg, Germany by Robin Rombach, Patrick Esser, Andreas Blattmann and Dominik Lorenz, the team that built Latent Diffusion at LMU Munich and Stable Diffusion at Stability AI. The company raised a $31M seed round led by Andreessen Horowitz in 2024 and launched the FLUX.1 family (pro, dev, schnell) plus the FLUX.1 Tools (Fill, Canny, Depth, Redux). Black Forest Labs positions itself as Europe's flagship open foundation-model lab for generative media.

Архітектура

Rectified-flow Diffusion Transformer (DiT) with depth-map structural conditioning

FLUX.1 Depth is part of the FLUX.1 Tools suite released in late 2024. It extends the base FLUX.1 [dev] / [pro] rectified-flow DiT backbone with an additional conditioning branch that consumes a depth map (typically produced by MiDaS, Depth Anything v2 or ZoeDepth) of a reference image. Depth features are injected into DiT blocks via ControlNet-style adapters so that the generated image preserves the 3D layout (perspective, occlusions, scale) of the source while colour, materials, lighting and style are dictated by the text prompt. The model uses T5-XXL plus CLIP-L text encoders and a 16x VAE, and samples with 28-50 flow-matching steps. Black Forest Labs fine-tuned the conditioning branch on a large licensed corpus of depth-image pairs, building on the rectified-flow training recipe from the SD3 paper (Esser et al. 2024).

Параметри

~12B (FLUX.1 dev backbone) plus depth conditioning branch

Контекст

512 токенів

Можливості

• Depth-conditioned generation that preserves 3D scene structure
• Works at up to 2 MP output resolution
• Strong photorealism and prompt fidelity inherited from FLUX.1
• Ideal for view-consistent restyling of indoor/outdoor scenes
• Compatible with depth maps from MiDaS, Depth Anything v2, ZoeDepth
• Pairs well with Canny and Fill for compound conditioning workflows
• Best for: interior design visualisation, automotive renders, architectural restyling, world-building.

Навчання та ліцензія

Fine-tuned from FLUX.1 base weights on pairs of images and estimated depth maps from a curated licensed corpus. Exact composition is not disclosed.

Ліцензія: FLUX.1 [dev] non-commercial license for dev weights; FLUX.1 [pro] commercial only via API.

Тестування безпеки: Inherits safety filters of the base FLUX.1 family including CSAM, NCII and IP-related guardrails.