liuhaoran 8ff65abbc6 ext_redis.py support redis clusters --- Fixes #9538 (#9789) 1 рік тому
..
.idea 7ae728a9a3 fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 1 рік тому
.vscode e61752bd3a feat/enhance the multi-modal support (#8818) 1 рік тому
configs 8ff65abbc6 ext_redis.py support redis clusters --- Fixes #9538 (#9789) 1 рік тому
constants db1d2aaff5 Feat/add Slovensko (Slovenija) (#10731) 1 рік тому
contexts e61752bd3a feat/enhance the multi-modal support (#8818) 1 рік тому
controllers 904ea05bf6 fix: download some remote files raise error (#10781) 1 рік тому
core bf4b6e5f80 feat: support custom tool upload file (#10796) 1 рік тому
docker 931e76e3d1 fix: remove unused queue `generation` (#10532) 1 рік тому
events e61752bd3a feat/enhance the multi-modal support (#8818) 1 рік тому
extensions 8ff65abbc6 ext_redis.py support redis clusters --- Fixes #9538 (#9789) 1 рік тому
factories 464cc26ccf Fix : Add a process to fetch the mime type from the file name for signed url in remote_url (#10872) 1 рік тому
fields 6e23903c63 Conversation delete issue (#10423) 1 рік тому
libs 51db59622c chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 1 рік тому
migrations 128efc3193 Feat/clean message records (#10588) 1 рік тому
models 328965ed7c Fix: crash of workflow file upload (#10831) 1 рік тому
schedule 128efc3193 Feat/clean message records (#10588) 1 рік тому
services c49efc0c22 Feat/account not found (#10804) 1 рік тому
tasks 51db59622c chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 1 рік тому
templates 4fd2743efa Feat/new login (#8120) 1 рік тому
tests 8ff65abbc6 ext_redis.py support redis clusters --- Fixes #9538 (#9789) 1 рік тому
.dockerignore 27f0ae8416 build: support Poetry for depencencies tool in api's Dockerfile (#5105) 1 рік тому
.env.example 8ff65abbc6 ext_redis.py support redis clusters --- Fixes #9538 (#9789) 1 рік тому
Dockerfile a3155e0613 Update expat version (#10686) 1 рік тому
README.md eafe5a9d8f chore(ci): bring back poetry cache to speed up CI jobs (#10347) 1 рік тому
app.py 3e04c92ff9 chore(api): remove setting of expired remember_token cookie in after_request (#10582) 1 рік тому
app_factory.py 0e8ab0588f fix: (#10437 followup) fix conditions with DEBUG config (#10438) 1 рік тому
commands.py 51db59622c chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 1 рік тому
poetry.lock 90d6ebc879 Add youtube-transcript-api as tool (#10772) 1 рік тому
poetry.toml f62f71a81a build: initial support for poetry build tool (#4513) 1 рік тому
pyproject.toml 90d6ebc879 Add youtube-transcript-api as tool (#10772) 1 рік тому
pytest.ini 0ebd985672 feat: add models for gitee.ai (#9490) 1 рік тому

README.md

Dify Backend API

Usage

[!IMPORTANT] In the v0.6.12 release, we deprecated pip as the package management tool for Dify API Backend service and replaced it with poetry.

  1. Start the docker-compose stack

The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

   cd ../docker
   cp middleware.env.example middleware.env
   # change the profile to other vector database if you are not using weaviate
   docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
   cd ../api
  1. Copy .env.example to .env
  2. Generate a SECRET_KEY in the .env file.
   sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
   secret_key=$(openssl rand -base64 42)
   sed -i '' "/^SECRET_KEY=/c\\
   SECRET_KEY=${secret_key}" .env
  1. Create environment.

Dify API service uses Poetry to manage dependencies. You can execute poetry shell to activate the environment.

  1. Install dependencies
   poetry env use 3.10
   poetry install

In case of contributors missing to update dependencies for pyproject.toml, you can perform the following shell instead.

   poetry shell                                               # activate current environment
   poetry add $(cat requirements.txt)           # install dependencies of production and update pyproject.toml
   poetry add $(cat requirements-dev.txt) --group dev    # install dependencies of development and update pyproject.toml
  1. Run migrate

Before the first launch, migrate the database to the latest version.

   poetry run python -m flask db upgrade
  1. Start backend
   poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
  1. Start Dify web service.
  2. Setup your application by visiting http://localhost:3000...
  3. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.
   poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment
   poetry install -C api --with dev
  1. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml
   poetry run -C api bash dev/pytest/pytest_all_tests.sh