This is an automated email from the ASF dual-hosted git repository.
abeizn pushed a change to branch release-v1.0
in repository https://gitbox.apache.org/repos/asf/incubator-devlake.git
from d510f597c fix: unnecessary loading (#7183) (#7187)
new b8cbb4299 fix and refactor: db migration logging logic (#7188)
new f0792057e fix: no correct reset state (#7191)
new e0fab64d2 feat: add onboard keyvalue api (#7189)
new ec741820d feat: add ready and health probes (#7195)
new 8f070f257 fix(projects): limit project name's max length to 100 (#7201)
new 4287750ae fixing #7100 by adding auto-discovery of interface type
(ipv4/ipv6) inside container (#7197)
new db544eafd feat: add onboard process (#7199)
new f4ec13cc5 feat: Configurable logging for PyDevLake (#7206)
new 4fd2e0906 fix: add missing config for the ADO Go Plugin (#7209)
new b657748a9 fix: jira jql checker add debug log (#7215)
new 7053c3a4b feat: update four Git dashboards (#7214)
new 2fdc61fd7 feat: add subtask logs details api (#7205)
new 0a7410c58 feat: add onboard finish status (#7218)
new 13ae38a8f fix: modify variable name format (#7222)
new 008217218 fix: something error for onboard result api interface (#7221)
new c61564cd3 fix: onboard cannot go back (#7223)
new acc754516 fix: plugins sort and update progress percentage calculation
(#7224)
new d0edd1075 feat: add project exist check (#7228)
new 22eff4a3d fix: remove refdiff plugin where scope config is nil (#7230)
new 5eb148518 feat: support image zoom in onboard (#7225)
new 16d71436e feat: improve the qa for onboard (#7226)
new fe4340234 fix: missed dashboard link in onboard (#7232)
new 12996ff2c fix: adjust the collect default time to 14 days (#7231)
new a4b485855 fix: missed finish operate for onboard (#7233)
new 366725232 refactor: add devops release file (#7234)
new 6614282e0 fix: plugins option add full name field (#7236)
new 5e369b2dd fix: some bugs for onboard (#7235)
new 89d022be4 feat: add cicd metrics to Bitbucket dashboard (#7240)
new 7d7880e61 fix: upgrade tasks sort logic (#7239)
new 0ea10b3c1 docs: polish the wording for the onboard process (#7242)
new e37d64b50 feat: add confirm modal for onboard close (#7245)
new c348f17ca fix: missed project name check (#7244)
new 8ea3cfc7a fix: test status not reset when token changed (#7246)
new 7b95c9fa9 fix: some bugs for onboard (#7248)
new fbebb66bc feat: add custom markdown component (#7250)
new ed6bbdf2c fix: progress revert in onboard subtask progress (#7251)
new fecb100ab fix: adjust the style for onboard subtask name (#7252)
new bb4b26b1f fix: some bugs for onboard (#7253)
new ec4cab1dc fix: missed recollect operate in onboard (#7254)
new d27f5a54f fix: incorrect current pipeline in onboard recollect (#7256)
The 40 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
backend/core/errors/types.go | 5 +-
...task_table.go => 20240318_add_devlake_store.go} | 29 +-
..._tasks.go => 20240322_add_field_to_subtasks.go} | 32 +-
backend/core/models/migrationscripts/register.go | 2 +
backend/core/models/project.go | 18 +
backend/core/models/task.go | 72 +-
backend/core/plugin/plugin_task.go | 12 +-
backend/core/runner/run_task.go | 68 +-
backend/helpers/pluginhelper/api/api_collector.go | 2 +-
backend/plugins/bitbucket/api/blueprint_v200.go | 9 +-
.../plugins/bitbucket/tasks/account_convertor.go | 2 +-
.../plugins/bitbucket/tasks/commit_collector.go | 2 +-
.../plugins/bitbucket/tasks/commit_convertor.go | 5 +-
.../plugins/bitbucket/tasks/commit_extractor.go | 5 +-
.../bitbucket/tasks/deployment_collector.go | 2 +-
.../bitbucket/tasks/deployment_convertor.go | 9 +-
.../bitbucket/tasks/deployment_extractor.go | 5 +-
backend/plugins/bitbucket/tasks/issue_collector.go | 2 +-
.../bitbucket/tasks/issue_comment_collector.go | 2 +-
.../bitbucket/tasks/issue_comment_convertor.go | 2 +-
.../bitbucket/tasks/issue_comment_extractor.go | 2 +-
backend/plugins/bitbucket/tasks/issue_convertor.go | 2 +-
backend/plugins/bitbucket/tasks/issue_extractor.go | 2 +-
.../plugins/bitbucket/tasks/pipeline_collector.go | 2 +-
.../plugins/bitbucket/tasks/pipeline_convertor.go | 2 +-
.../plugins/bitbucket/tasks/pipeline_extractor.go | 3 +-
.../bitbucket/tasks/pipeline_steps_collector.go | 2 +-
.../bitbucket/tasks/pipeline_steps_convertor.go | 2 +-
.../bitbucket/tasks/pipeline_steps_extractor.go | 2 +-
backend/plugins/bitbucket/tasks/pr_collector.go | 2 +-
.../bitbucket/tasks/pr_comment_collector.go | 2 +-
.../bitbucket/tasks/pr_comment_convertor.go | 2 +-
.../bitbucket/tasks/pr_comment_extractor.go | 2 +-
.../plugins/bitbucket/tasks/pr_commit_collector.go | 2 +-
.../plugins/bitbucket/tasks/pr_commit_convertor.go | 2 +-
.../plugins/bitbucket/tasks/pr_commit_extractor.go | 2 +-
backend/plugins/bitbucket/tasks/pr_convertor.go | 2 +-
backend/plugins/bitbucket/tasks/pr_extractor.go | 2 +-
backend/plugins/bitbucket/tasks/repo_convertor.go | 2 +-
.../plugins/gitextractor/parser/repo_libgit2.go | 12 +-
backend/plugins/gitextractor/tasks/clone.go | 5 +-
.../gitextractor/tasks/git_repo_collector.go | 8 +-
backend/plugins/github/api/blueprint_v200.go | 10 +-
backend/plugins/github/tasks/account_collector.go | 2 +-
backend/plugins/github/tasks/account_convertor.go | 2 +-
backend/plugins/github/tasks/account_extractor.go | 2 +-
.../plugins/github/tasks/account_org_collector.go | 2 +-
.../plugins/github/tasks/account_org_extractor.go | 2 +-
backend/plugins/github/tasks/cicd_job_collector.go | 2 +-
backend/plugins/github/tasks/cicd_job_convertor.go | 2 +-
backend/plugins/github/tasks/cicd_job_extractor.go | 2 +-
backend/plugins/github/tasks/cicd_run_collector.go | 2 +-
backend/plugins/github/tasks/cicd_run_convertor.go | 7 +-
backend/plugins/github/tasks/cicd_run_extractor.go | 2 +-
backend/plugins/github/tasks/comment_collector.go | 2 +-
backend/plugins/github/tasks/comment_extractor.go | 2 +-
backend/plugins/github/tasks/commit_collector.go | 2 +-
backend/plugins/github/tasks/commit_convertor.go | 2 +-
backend/plugins/github/tasks/commit_extractor.go | 2 +-
.../plugins/github/tasks/commit_stats_collector.go | 2 +-
.../plugins/github/tasks/commit_stats_extractor.go | 2 +-
.../plugins/github/tasks/deployment_convertor.go | 2 +-
backend/plugins/github/tasks/event_collector.go | 2 +-
backend/plugins/github/tasks/event_extractor.go | 2 +-
.../github/tasks/issue_assignee_convertor.go | 2 +-
backend/plugins/github/tasks/issue_collector.go | 2 +-
.../github/tasks/issue_comment_convertor.go | 2 +-
backend/plugins/github/tasks/issue_convertor.go | 2 +-
backend/plugins/github/tasks/issue_extractor.go | 2 +-
.../plugins/github/tasks/issue_label_convertor.go | 2 +-
.../plugins/github/tasks/milestone_collector.go | 2 +-
.../plugins/github/tasks/milestone_converter.go | 2 +-
.../plugins/github/tasks/milestone_extractor.go | 2 +-
backend/plugins/github/tasks/pr_collector.go | 2 +-
.../plugins/github/tasks/pr_comment_convertor.go | 2 +-
.../plugins/github/tasks/pr_commit_collector.go | 2 +-
.../plugins/github/tasks/pr_commit_convertor.go | 2 +-
.../plugins/github/tasks/pr_commit_extractor.go | 2 +-
backend/plugins/github/tasks/pr_convertor.go | 2 +-
backend/plugins/github/tasks/pr_extractor.go | 2 +-
backend/plugins/github/tasks/pr_issue_convertor.go | 2 +-
backend/plugins/github/tasks/pr_issue_enricher.go | 2 +-
backend/plugins/github/tasks/pr_label_convertor.go | 2 +-
.../plugins/github/tasks/pr_review_collector.go | 2 +-
.../github/tasks/pr_review_comment_collector.go | 2 +-
.../github/tasks/pr_review_comment_extractor.go | 2 +-
.../plugins/github/tasks/pr_review_convertor.go | 2 +-
.../plugins/github/tasks/pr_review_extractor.go | 2 +-
backend/plugins/github/tasks/repo_convertor.go | 2 +-
backend/plugins/github/tasks/task_data.go | 1 +
.../github_graphql/tasks/account_collector.go | 2 +-
.../github_graphql/tasks/account_extractor.go | 2 +-
.../github_graphql/tasks/deployment_collector.go | 2 +-
.../github_graphql/tasks/deployment_extractor.go | 2 +-
.../github_graphql/tasks/issue_collector.go | 2 +-
.../github_graphql/tasks/issue_extractor.go | 2 +-
.../plugins/github_graphql/tasks/job_collector.go | 2 +-
.../plugins/github_graphql/tasks/job_extractor.go | 2 +-
.../plugins/github_graphql/tasks/pr_collector.go | 2 +-
.../plugins/github_graphql/tasks/pr_extractor.go | 2 +-
backend/plugins/gitlab/api/blueprint_V200_test.go | 17 +-
backend/plugins/gitlab/api/blueprint_v200.go | 10 +-
backend/plugins/gitlab/tasks/account_collector.go | 2 +-
backend/plugins/gitlab/tasks/account_convertor.go | 2 +-
backend/plugins/gitlab/tasks/account_extractor.go | 2 +-
backend/plugins/gitlab/tasks/commit_collector.go | 2 +-
backend/plugins/gitlab/tasks/commit_convertor.go | 5 +-
backend/plugins/gitlab/tasks/commit_extractor.go | 3 +-
.../plugins/gitlab/tasks/deployment_collector.go | 2 +-
.../plugins/gitlab/tasks/deployment_convertor.go | 7 +-
.../plugins/gitlab/tasks/deployment_extractor.go | 2 +-
.../gitlab/tasks/issue_assignee_convertor.go | 2 +-
backend/plugins/gitlab/tasks/issue_collector.go | 2 +-
backend/plugins/gitlab/tasks/issue_convertor.go | 2 +-
backend/plugins/gitlab/tasks/issue_extractor.go | 2 +-
.../plugins/gitlab/tasks/issue_label_convertor.go | 5 +-
backend/plugins/gitlab/tasks/job_collector.go | 2 +-
backend/plugins/gitlab/tasks/job_convertor.go | 7 +-
backend/plugins/gitlab/tasks/job_extractor.go | 2 +-
backend/plugins/gitlab/tasks/mr_collector.go | 2 +-
.../plugins/gitlab/tasks/mr_comment_convertor.go | 2 +-
.../plugins/gitlab/tasks/mr_commit_collector.go | 2 +-
.../plugins/gitlab/tasks/mr_commit_convertor.go | 5 +-
.../plugins/gitlab/tasks/mr_commit_extractor.go | 2 +-
backend/plugins/gitlab/tasks/mr_convertor.go | 2 +-
.../plugins/gitlab/tasks/mr_detail_collector.go | 2 +-
.../plugins/gitlab/tasks/mr_detail_extractor.go | 2 +-
backend/plugins/gitlab/tasks/mr_enricher.go | 7 +-
backend/plugins/gitlab/tasks/mr_extractor.go | 2 +-
backend/plugins/gitlab/tasks/mr_label_convertor.go | 5 +-
backend/plugins/gitlab/tasks/mr_note_collector.go | 2 +-
backend/plugins/gitlab/tasks/mr_note_extractor.go | 2 +-
backend/plugins/gitlab/tasks/pipeline_collector.go | 2 +-
.../gitlab/tasks/pipeline_commit_convertor.go | 2 +-
.../gitlab/tasks/pipeline_detail_collector.go | 2 +-
.../gitlab/tasks/pipeline_detail_convertor.go | 2 +-
.../gitlab/tasks/pipeline_detail_extractor.go | 2 +-
backend/plugins/gitlab/tasks/pipeline_extractor.go | 2 +-
backend/plugins/gitlab/tasks/project_convertor.go | 2 +-
backend/plugins/gitlab/tasks/tag_collector.go | 2 +-
backend/plugins/gitlab/tasks/tag_extractor.go | 3 +-
backend/plugins/gitlab/tasks/task_data.go | 1 +
.../plugins/gitlab/tasks/trigger_job_collector.go | 2 +-
.../plugins/gitlab/tasks/trigger_job_extractor.go | 5 +-
.../jira/tasks/board_filter_begin_collector.go | 2 +-
.../jira/tasks/board_filter_end_collector.go | 2 +-
.../python/plugins/azuredevops/azuredevops/main.py | 2 +-
backend/python/pydevlake/pydevlake/api.py | 21 +-
.../pydevlake/{testing/__init__.py => config.py} | 14 +-
backend/python/pydevlake/pydevlake/ipc.py | 19 +-
backend/python/pydevlake/pydevlake/logger.py | 18 +-
.../python/pydevlake/pydevlake/pipeline_tasks.py | 1 +
backend/python/pydevlake/pydevlake/plugin.py | 3 +-
backend/python/pydevlake/pydevlake/subtasks.py | 3 +-
backend/server/api/api.go | 3 +-
backend/server/api/ping/ping.go | 34 +
backend/server/api/project/project.go | 35 +-
backend/server/api/router.go | 8 +-
.../server/api/{push/push.go => store/store.go} | 66 +-
backend/server/api/task/task.go | 24 +
backend/server/services/init.go | 33 +-
backend/server/services/probes.go | 58 +
backend/server/services/remote/bridge/cmd.go | 4 +-
backend/server/services/remote/bridge/context.go | 49 +-
.../misc_helpers.go => server/services/store.go} | 38 +-
backend/server/services/task.go | 145 +++
config-ui/Dockerfile | 2 +-
config-ui/nginx.conf | 3 +-
config-ui/nginx.sh | 19 +-
config-ui/package.json | 5 +-
config-ui/public/onboard/assets/github/1.png | Bin 0 -> 18549 bytes
config-ui/public/onboard/assets/github/2.png | Bin 0 -> 25492 bytes
config-ui/public/onboard/assets/github/3.png | Bin 0 -> 53740 bytes
config-ui/public/onboard/assets/gitlab/1.png | Bin 0 -> 22729 bytes
config-ui/public/onboard/assets/gitlab/2.png | Bin 0 -> 40874 bytes
config-ui/public/onboard/assets/gitlab/3.png | Bin 0 -> 23739 bytes
.../public/onboard/step-1/azuredevops.md | 17 +-
.../public/onboard/step-1/bitbucket.md | 17 +-
.../public/onboard/step-1/default.md | 16 +-
.../public/onboard/step-1/github.md | 17 +-
.../public/onboard/step-1/gitlab.md | 17 +-
config-ui/public/onboard/step-2/azuredevops.md | 35 +
config-ui/public/onboard/step-2/bitbucket.md | 44 +
config-ui/public/onboard/step-2/github.md | 44 +
config-ui/public/onboard/step-2/gitlab.md | 47 +
config-ui/public/onboard/step-3/azuredevops.md | 34 +
config-ui/public/onboard/step-3/bitbucket.md | 34 +
config-ui/public/onboard/step-3/github.md | 34 +
config-ui/public/onboard/step-3/gitlab.md | 34 +
config-ui/src/api/index.ts | 4 +-
config-ui/src/api/pipeline/index.ts | 4 +
.../data-scope-remote => api/pipeline}/types.ts | 35 +-
config-ui/src/api/project/index.ts | 2 +
config-ui/src/api/{task => store}/index.ts | 7 +-
config-ui/src/app/routrer.tsx | 23 +-
config-ui/src/components/block/index.tsx | 2 +-
config-ui/src/components/index.ts | 1 +
.../src/components/{block => markdown}/index.tsx | 59 +-
config-ui/src/hooks/use-auto-refresh.ts | 2 +-
.../components/connection-form/fields/password.tsx | 1 -
.../components/connection-form/fields/token.tsx | 1 -
.../components/connection-form/fields/username.tsx | 18 -
.../components/connection-name}/index.tsx | 39 +-
.../components/connection-select/index.tsx} | 49 +-
.../data-scope-remote/data-scope-remote.tsx | 56 +-
.../components/data-scope-remote/search-local.tsx | 4 +-
.../components/data-scope-remote/search-remote.tsx | 12 +-
config-ui/src/plugins/components/index.ts | 2 +
.../plugins/components/scope-config-form/index.tsx | 8 +
.../register/github/connection-fields/token.tsx | 2 +-
config-ui/src/release/stable.ts | 7 +
config-ui/src/routes/index.ts | 1 +
config-ui/src/routes/layout/config.tsx | 10 +-
config-ui/src/routes/layout/layout.tsx | 5 +-
config-ui/src/routes/layout/loader.ts | 7 +
config-ui/src/routes/onboard/components/card.tsx | 61 +
.../onboard}/components/index.ts | 3 +-
config-ui/src/routes/onboard/components/logs.tsx | 129 ++
.../onboard/context.tsx} | 32 +-
config-ui/src/routes/onboard/index.tsx | 139 +++
config-ui/src/routes/onboard/step-0.tsx | 106 ++
config-ui/src/routes/onboard/step-1.tsx | 132 ++
config-ui/src/routes/onboard/step-2.tsx | 210 ++++
config-ui/src/routes/onboard/step-3.tsx | 164 +++
config-ui/src/routes/onboard/step-4.tsx | 315 +++++
config-ui/src/routes/onboard/styled.ts | 158 +++
config-ui/src/routes/project/home/index.tsx | 58 +-
config-ui/src/routes/project/home/styled.ts | 34 -
config-ui/vite.config.ts | 2 +-
config-ui/yarn.lock | 945 +++++++++++++-
.../docker-compose.yml | 6 +-
.../{lake-v0.20.0 => lake-v0.21.0}/env.example | 3 +
grafana/dashboards/AzureDevOps.json | 793 +++++++-----
grafana/dashboards/BitBucket.json | 1306 ++++++++++++++++++--
grafana/dashboards/GitHub.json | 1167 +++++++++--------
grafana/dashboards/Gitlab.json | 1173 +++++++++++++++---
236 files changed, 7204 insertions(+), 1713 deletions(-)
copy
backend/core/models/migrationscripts/{20220601_add_subtasks_to_task_table.go =>
20240318_add_devlake_store.go} (58%)
copy backend/core/models/migrationscripts/{20220908_modify_cicd_tasks.go =>
20240322_add_field_to_subtasks.go} (58%)
copy backend/python/pydevlake/pydevlake/{testing/__init__.py => config.py}
(78%)
copy backend/server/api/{push/push.go => store/store.go} (50%)
create mode 100644 backend/server/services/probes.go
copy backend/{helpers/pluginhelper/api/misc_helpers.go =>
server/services/store.go} (52%)
create mode 100644 config-ui/public/onboard/assets/github/1.png
create mode 100644 config-ui/public/onboard/assets/github/2.png
create mode 100644 config-ui/public/onboard/assets/github/3.png
create mode 100644 config-ui/public/onboard/assets/gitlab/1.png
create mode 100644 config-ui/public/onboard/assets/gitlab/2.png
create mode 100644 config-ui/public/onboard/assets/gitlab/3.png
copy backend/plugins/gitee/README.md =>
config-ui/public/onboard/step-1/azuredevops.md (66%)
copy backend/plugins/gitee/README.md =>
config-ui/public/onboard/step-1/bitbucket.md (68%)
copy backend/plugins/gitee/README.md =>
config-ui/public/onboard/step-1/default.md (68%)
copy backend/plugins/gitee/README.md =>
config-ui/public/onboard/step-1/github.md (67%)
copy backend/plugins/gitee/README.md =>
config-ui/public/onboard/step-1/gitlab.md (68%)
create mode 100644 config-ui/public/onboard/step-2/azuredevops.md
create mode 100644 config-ui/public/onboard/step-2/bitbucket.md
create mode 100644 config-ui/public/onboard/step-2/github.md
create mode 100644 config-ui/public/onboard/step-2/gitlab.md
create mode 100644 config-ui/public/onboard/step-3/azuredevops.md
create mode 100644 config-ui/public/onboard/step-3/bitbucket.md
create mode 100644 config-ui/public/onboard/step-3/github.md
create mode 100644 config-ui/public/onboard/step-3/gitlab.md
copy config-ui/src/{plugins/components/data-scope-remote =>
api/pipeline}/types.ts (67%)
copy config-ui/src/api/{task => store}/index.ts (83%)
copy config-ui/src/components/{block => markdown}/index.tsx (55%)
copy config-ui/src/{components/action/copy-text =>
plugins/components/connection-name}/index.tsx (62%)
copy config-ui/src/{features/connections/components/name.tsx =>
plugins/components/connection-select/index.tsx} (59%)
create mode 100644 config-ui/src/routes/onboard/components/card.tsx
copy config-ui/src/{features/connections =>
routes/onboard}/components/index.ts (94%)
create mode 100644 config-ui/src/routes/onboard/components/logs.tsx
copy config-ui/src/{hooks/user-proxy-prefix.ts => routes/onboard/context.tsx}
(58%)
create mode 100644 config-ui/src/routes/onboard/index.tsx
create mode 100644 config-ui/src/routes/onboard/step-0.tsx
create mode 100644 config-ui/src/routes/onboard/step-1.tsx
create mode 100644 config-ui/src/routes/onboard/step-2.tsx
create mode 100644 config-ui/src/routes/onboard/step-3.tsx
create mode 100644 config-ui/src/routes/onboard/step-4.tsx
create mode 100644 config-ui/src/routes/onboard/styled.ts
delete mode 100644 config-ui/src/routes/project/home/styled.ts
copy devops/releases/{lake-v0.20.0 => lake-v0.21.0}/docker-compose.yml (96%)
copy devops/releases/{lake-v0.20.0 => lake-v0.21.0}/env.example (90%)
