Conversation
* logging instrumentator * add logging instrumentator in server and simplify docker compose * remove edit from dockerfile * setting all version of containers, not latest
* Add OpenDP Polars (opendp v0.12) * Add new tests for opendp polars * Add notebook for Polars * Datetime compatibility not included at the moment * Minor fixes in code base
* Add RabbitMQ queues and Devenv * Always use MongoDB -> Remove YamlDBConfig * Always use MinIO
* Add Keycloak in devenv (and it's supporting postgres) * Split the devenv.nix a bit for ease of edit * Add some (pdb) run script examples
* setup.py -> pyproject.toml * relax minor dev requirements * add server/dashboard processes * build doc on pull request but don't publish it * fix build from root (setuptools)
* Adding authentication dependency to endpoints with FreePass authenticator and jwt authenticator. Client works with both methods. * Updated admin methods to include user addition into keycloak. Created lomas_demo_setup script to be run in a separate container (instead of filling up the mongodb from the fastapi server). Move configs models and merge them when possible. * Add keycloak user management to lomas dashboard. Remove some dashboard tests until we have a proper dev environment that spins a mongodb and a keycloak service. * Update notebooks and clean client. * PEP 639: SPDX license --------- Co-authored-by: Bruno Studer <bruno.studer@protonmail.com>
* Fixing Dockerfile and dependencies * Used variable interpolation in docker compose test and auto-generate ground truth .env.docker-compose file from devenv * Automatically generate config files and parametrize docker compose * Added docker-compose-up and -down utility scripts + updated docs
* QoL: disable cuda-by-default on torch pull / cachix
* Added path prefix to admin functions (add via yaml, etc.). Made tests agnostic to where they are run from. Fixed issue with dashboard config * quick fix in dockerfile
* Add stdout logging
* [rabbitmq] retry connect * add timeout
* [devenv] adding loki & tempo * [devenv] add opentelemetry collector * namespaced telemetry processes * [postgres] startup clean * add a help section * add grafana * switch default namespace to default * bump deps * typo / dups
- Added setup jobs (keycloak setup and demo setup) - Added dependencies between jobs/server/worker and keycloak/mongo.
* Adding client tests * Server re-enqueues messages to result queue if it does not recognise job id. Allows for server to be live even during tests that use fastapi's test client * fix all notebooks and make separate tests for each notebook. * trying to fix worker * running notebooks
* Pydantic-Settings * tiny hook * classifiers * add nbstripout * notebook normalize * remove conflicting sdps * server depends on mongo * docker compose tests + some fixes add try loop for sql query in notebook * added dataset collection, updated compose test script * skipping smartnoise notebook * rerun notebooks * tiny * git attributes * split mongo dsn into url, user and password for compatibility with k8 secrets * split-coverage --------- Co-authored-by: Bruno Studer <bruno.studer@protonmail.com>
additional linting
* Add keycloak admin tests
* enable selected proportion of nullable, not just boolean * rename to nullable_proportion * add annotation
* switch all configs to env var in helm chart * adding secrets in helm charts * Make telemetry fields optional when not enabled, make private_db_credentials optional * Run notebooks * Upload test logs as artifacts of github action (worker included)
Split devenv into modules
* Restore smartnoise-SQL using custom version of smartnoise * Restore tests on notebooks using smartnoise-sql * Skip notebook with opendp legacy
* [pyenv] build fix diffprivlib 0.6.6 & sklearn 1.8.0 issue * [on-going] dashboarding * rebase * cleanup oauthlib * choose password flow by default * [redoc/swagger] fix doc * [on-going] podman * ignore dashboard cov * path prefixes * build action * stream image layers * post-rebase adaptations * Fix docker-compose * fix devenv version * Add popup before deletion, change delete dataset layout * Fix linters * Test github action with another notebook * bump dex * trim gitignore * client should depend on lomas_demo_setup * add healthcheck * head CodeQL deprecation warning * flowy * demo-setup no silent fail * dex 2.44.0 * fastapi bump * github actions node warning * github actions bump nix * add per-dataset metadata upload --------- Co-authored-by: Damien <damien.aymon@bfs.admin.ch> Co-authored-by: LancelotMarti <lancelot.marti@gmail.com>
* Use forked diffprivlib * uv.lock reflecting changes --------- Co-authored-by: Bruno Studer <bruno.studer@protonmail.com>
* update publish workflow * classifiers * beta1
* dep update * rabbitmq disable transient non-exclusive queues * no erl crash dump * action bump devenv version msg fix
* rough conversion, all metadata to tablemetadata from csvw-safe * importing csvw safe, and using its functionnalities * fixing local database models and dateTime gor birthdays * expect TableMetadata everywehre in Lomas, to dict to outside and from_dict to load * fixed diffprivlib * fixed all smartnoise_sql api test * opendp context need all argument, force nb query to 1 in lomas * opendp fixed with dp-len when required * 8fix integration text, no privacy id * global cleaning and puitting XDG_RUNTIME_DIR back for nix * adapting client notebooks * add functions in client to get bounds in right format more easily * adapting notebooks using new client functionnalities * new version of metadata with invariant keys for opendp multi group by * data connector for all types of datetime * hoist by my own .gitattributes petard * move csvw dep to core * add encoding warning * addressing pr comments * imprting csvw sake from pyi --------- Co-authored-by: Bruno Studer <bruno.studer@protonmail.com>
* backup * single user add works, still multi-user todo * yaml import also working * add delete functions and cleanup * demo setup should not fail if no dex config * revert id token ttl * fix lomas setup --------- Co-authored-by: Bruno Studer <bruno.studer@protonmail.com>
* doc fixier * dependencies update
* bump devenv 2.1.2
* Fix telemetry * fix linters * keep csvw-eo only in core * relax telemetry env requirements * fix telemetry variables --------- Co-authored-by: Bruno Studer <bruno.studer@protonmail.com>
* Add initcontainers for worker and server * Template image initcontainers and resources
devenv.garage fix
* release v0.5.0
Member
Coverage report
Warning The diff for this PR is too large to be retrieved from GitHub's API (maximum 300 files). Diff coverage is not available for this PR. This PR does not seem to contain any modification to coverable code. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.