Project export fails with empty error message (email).
Summary
Project export fails? When I try with this project hosted on a private AWS server (Heptapod 0.20.6 (GitLab CE 13.9.6)) I get a email with the (empty) message:
Project mmf-setup couldn't be exported.
The errors we encountered were:
Steps to reproduce
Click Export project
from Settings/General/Advance/Export project
on this project.
Relevant logs and/or screenshots
Error details
(Captured by running docker exec -it ${heptapod_id} gitlab-ctl tail
on the server while triggering the export.)
==> /var/log/gitlab/gitlab-exporter/current <==
2021-05-03_21:10:58.71508 127.0.0.1 - - [03/May/2021:21:10:58 UTC] "GET /database HTTP/1.1" 200 1808
2021-05-03_21:10:58.71556 - -> /database
==> /var/log/gitlab/gitlab-rails/production.log <==
Started POST "/forbes-group/mmf-setup/export" for 134.121.19.107 at 2021-05-03 21:11:00 +0000
Processing by ProjectsController#export as HTML
Parameters: {"authenticity_token"=>"[FILTERED]", "namespace_id"=>"forbes-group", "id"=>"mmf-setup"}
==> /var/log/gitlab/gitlab-rails/application.log <==
2021-05-03T21:11:00.957Z: Export job started for project ID 81 with job ID bb142b850556a692c8dab9a1
==> /var/log/gitlab/gitlab-rails/application_json.log <==
{"severity":"INFO","time":"2021-05-03T21:11:00.958Z","correlation_id":"01F4T13VFR114C0S1AVCM111AS","message":"Export job started for project ID 81 with job ID bb142b850556a692c8dab9a1"}
==> /var/log/gitlab/sidekiq/current <==
{"severity":"INFO","time":"2021-05-03T21:11:00.959Z","class":"ProjectExportWorker","args":["2","81","","{}"],"retry":0,"queue":"project_export","version":0,"backtrace":5,"dead":false,"status_expiration":21600,"jid":"bb142b850556a692c8dab9a1","created_at":"2021-05-03T21:11:00.954Z","meta.user":"mforbes","meta.project":"forbes-group/mmf-setup","meta.root_namespace":"forbes-group","meta.caller_id":"ProjectsController#export","meta.remote_ip":"134.121.19.107","meta.feature_category":"importers","correlation_id":"01F4T13VFR114C0S1AVCM111AS","enqueued_at":"2021-05-03T21:11:00.956Z","pid":569,"message":"ProjectExportWorker JID-bb142b850556a692c8dab9a1: start","job_status":"start","scheduling_latency_s":0.002016,"job_size_bytes":513}
==> /var/log/gitlab/gitlab-rails/production.log <==
Redirected to https://hg.iscimath.org/forbes-group/mmf-setup/edit#js-export-project
Completed 302 Found in 67ms (ActiveRecord: 24.7ms | Elasticsearch: 0.0ms | Allocations: 11040)
==> /var/log/gitlab/gitlab-rails/production_json.log <==
{"method":"POST","path":"/forbes-group/mmf-setup/export","format":"html","controller":"ProjectsController","action":"export","status":302,"location":"https://hg.iscimath.org/forbes-group/mmf-setup/edit#js-export-project","time":"2021-05-03T21:11:00.969Z","params":[{"key":"_method","value":"post"},{"key":"authenticity_token","value":"[FILTERED]"},{"key":"namespace_id","value":"forbes-group"},{"key":"id","value":"mmf-setup"}],"remote_ip":"134.121.19.107","user_id":2,"username":"mforbes","ua":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36","correlation_id":"01F4T13VFR114C0S1AVCM111AS","meta.user":"mforbes","meta.project":"forbes-group/mmf-setup","meta.root_namespace":"forbes-group","meta.caller_id":"ProjectsController#export","meta.remote_ip":"134.121.19.107","meta.feature_category":"importers","redis_calls":5,"redis_duration_s":0.001191,"redis_read_bytes":306,"redis_write_bytes":1794,"redis_cache_calls":2,"redis_cache_duration_s":0.000367,"redis_cache_read_bytes":2,"redis_cache_write_bytes":104,"redis_queues_calls":2,"redis_queues_duration_s":0.000367,"redis_queues_read_bytes":60,"redis_queues_write_bytes":992,"redis_shared_state_calls":1,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":244,"redis_shared_state_write_bytes":698,"db_count":7,"db_write_count":0,"db_cached_count":1,"cpu_s":0.054949,"queue_duration_s":0.008869,"db_duration_s":0.02473,"view_duration_s":0.0,"duration_s":0.06777}
==> /var/log/gitlab/gitlab-workhorse/current <==
{"content_type":"text/html; charset=utf-8","correlation_id":"01F4T13VFR114C0S1AVCM111AS","duration_ms":116,"host":"hg.iscimath.org","level":"info","method":"POST","msg":"access","proto":"HTTP/1.1","referrer":"https://hg.iscimath.org/forbes-group/mmf-setup/edit","remote_addr":"134.121.19.107:0","remote_ip":"134.121.19.107","route":"","status":302,"system":"http","time":"2021-05-03T21:11:00Z","ttfb_ms":116,"uri":"/forbes-group/mmf-setup/export","user_agent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36","written_bytes":135}
==> /var/log/gitlab/nginx/gitlab_access.log <==
134.121.19.107 - - [03/May/2021:21:11:00 +0000] "POST /forbes-group/mmf-setup/export HTTP/2.0" 302 135 "https://hg.iscimath.org/forbes-group/mmf-setup/edit" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36" -
==> /var/log/gitlab/gitlab-rails/production.log <==
Started GET "/forbes-group/mmf-setup/edit" for 134.121.19.107 at 2021-05-03 21:11:01 +0000
Processing by ProjectsController#edit as HTML
Parameters: {"namespace_id"=>"forbes-group", "id"=>"mmf-setup"}
==> /var/log/gitlab/puma/puma_stdout.log <==
{"timestamp":"2021-05-03T21:11:01.480Z","pid":551,"message":"PumaWorkerKiller: Consuming 2460.609375 mb with master and 2 workers."}
==> /var/log/gitlab/gitlab-rails/production.log <==
Completed 200 OK in 519ms (Views: 196.5ms | ActiveRecord: 290.7ms | Elasticsearch: 0.0ms | Allocations: 80006)
==> /var/log/gitlab/gitlab-rails/production_json.log <==
{"method":"GET","path":"/forbes-group/mmf-setup/edit","format":"html","controller":"ProjectsController","action":"edit","status":200,"time":"2021-05-03T21:11:01.568Z","params":[{"key":"namespace_id","value":"forbes-group"},{"key":"id","value":"mmf-setup"}],"remote_ip":"134.121.19.107","user_id":2,"username":"mforbes","ua":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36","correlation_id":"01F4T13VMZWH13GBVDPW8XBEHA","meta.user":"mforbes","meta.project":"forbes-group/mmf-setup","meta.root_namespace":"forbes-group","meta.caller_id":"ProjectsController#edit","meta.remote_ip":"134.121.19.107","meta.feature_category":"projects","redis_calls":23,"redis_duration_s":0.008201,"redis_read_bytes":4848,"redis_write_bytes":2473,"redis_cache_calls":22,"redis_cache_duration_s":0.007841,"redis_cache_read_bytes":4444,"redis_cache_write_bytes":1261,"redis_shared_state_calls":1,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":404,"redis_shared_state_write_bytes":1212,"db_count":29,"db_write_count":0,"db_cached_count":2,"cpu_s":0.229161,"queue_duration_s":0.00566,"db_duration_s":0.29073,"view_duration_s":0.19655,"duration_s":0.51955}
==> /var/log/gitlab/gitlab-workhorse/current <==
{"content_type":"text/html; charset=utf-8","correlation_id":"01F4T13VMZWH13GBVDPW8XBEHA","duration_ms":549,"host":"hg.iscimath.org","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"https://hg.iscimath.org/forbes-group/mmf-setup/edit","remote_addr":"134.121.19.107:0","remote_ip":"134.121.19.107","route":"","status":200,"system":"http","time":"2021-05-03T21:11:01Z","ttfb_ms":549,"uri":"/forbes-group/mmf-setup/edit","user_agent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36","written_bytes":106339}
==> /var/log/gitlab/nginx/gitlab_access.log <==
134.121.19.107 - - [03/May/2021:21:11:01 +0000] "GET /forbes-group/mmf-setup/edit HTTP/2.0" 200 27156 "https://hg.iscimath.org/forbes-group/mmf-setup/edit" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36" 3.92
==> /var/log/gitlab/gitlab-rails/production.log <==
Scoped order is ignored, it's forced to be batch order.
==> /var/log/gitlab/gitlab-exporter/current <==
2021-05-03_21:11:02.06943 127.0.0.1 - - [03/May/2021:21:11:02 UTC] "GET /ruby HTTP/1.1" 200 1011
2021-05-03_21:11:02.06966 - -> /ruby
==> /var/log/gitlab/gitlab-rails/production.log <==
Started GET "/api/v4/projects/81/badges" for 134.121.19.107 at 2021-05-03 21:11:02 +0000
Processing by Gitlab::RequestForgeryProtection::Controller#index as HTML
Completed 200 OK in 0ms (ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 86)
==> /var/log/gitlab/gitlab-rails/api_json.log <==
{"time":"2021-05-03T21:11:02.153Z","severity":"INFO","duration_s":0.04783,"db_duration_s":0.01656,"view_duration_s":0.03127,"status":200,"method":"GET","path":"/api/v4/projects/81/badges","params":[],"host":"hg.iscimath.org","remote_ip":"134.121.19.107, 134.121.19.107","ua":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36","route":"/api/:version/projects/:id/badges","user_id":2,"username":"mforbes","queue_duration_s":0.011313,"redis_calls":2,"redis_duration_s":0.001445,"redis_read_bytes":446,"redis_write_bytes":760,"redis_cache_calls":1,"redis_cache_duration_s":0.00029,"redis_cache_read_bytes":202,"redis_cache_write_bytes":64,"redis_shared_state_calls":1,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":244,"redis_shared_state_write_bytes":696,"db_count":5,"db_write_count":0,"db_cached_count":0,"cpu_s":0.038552,"correlation_id":"01F4T13WPD6D6182SV5W4QQRHZ","meta.user":"mforbes","meta.caller_id":"/api/:version/projects/:id/badges","meta.remote_ip":"134.121.19.107","meta.feature_category":"continuous_integration"}
==> /var/log/gitlab/gitlab-workhorse/current <==
{"content_type":"","correlation_id":"01F4T13WPD6D6182SV5W4QQRHZ","duration_ms":62,"host":"hg.iscimath.org","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"https://hg.iscimath.org/forbes-group/mmf-setup/edit","remote_addr":"134.121.19.107:0","remote_ip":"134.121.19.107","route":"^/api/","status":304,"system":"http","time":"2021-05-03T21:11:02Z","ttfb_ms":62,"uri":"/api/v4/projects/81/badges","user_agent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36","written_bytes":0}
==> /var/log/gitlab/nginx/gitlab_access.log <==
134.121.19.107 - - [03/May/2021:21:11:02 +0000] "GET /api/v4/projects/81/badges HTTP/2.0" 304 0 "https://hg.iscimath.org/forbes-group/mmf-setup/edit" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36" -
==> /var/log/gitlab/sidekiq/current <==
{"severity":"INFO","time":"2021-05-03T21:11:03.603Z","queue":"cronjob:user_status_cleanup_batch","args":[],"class":"UserStatusCleanup::BatchWorker","retry":0,"version":0,"queue_namespace":"cronjob","jid":"2cb11b7fd4dbf3cc8f44c6ad","created_at":"2021-05-03T21:11:03.601Z","meta.caller_id":"Cronjob","correlation_id":"2bc333a5708b7937e37b230513f3222d","enqueued_at":"2021-05-03T21:11:03.602Z","pid":569,"message":"UserStatusCleanup::BatchWorker JID-2cb11b7fd4dbf3cc8f44c6ad: start","job_status":"start","scheduling_latency_s":0.001601,"job_size_bytes":327}
{"severity":"INFO","time":"2021-05-03T21:11:03.696Z","queue":"cronjob:schedule_merge_request_cleanup_refs","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","retry":0,"version":0,"queue_namespace":"cronjob","jid":"fcd0848fc73bd8a009a84f10","created_at":"2021-05-03T21:11:03.692Z","meta.caller_id":"Cronjob","correlation_id":"985ba13fad94c4990ad0a85fea77076e","enqueued_at":"2021-05-03T21:11:03.693Z","pid":569,"message":"ScheduleMergeRequestCleanupRefsWorker JID-fcd0848fc73bd8a009a84f10: start","job_status":"start","scheduling_latency_s":0.003219,"job_size_bytes":343}
{"severity":"INFO","time":"2021-05-03T21:11:03.698Z","queue":"cronjob:user_status_cleanup_batch","args":[],"class":"UserStatusCleanup::BatchWorker","retry":0,"version":0,"queue_namespace":"cronjob","jid":"2cb11b7fd4dbf3cc8f44c6ad","created_at":"2021-05-03T21:11:03.601Z","meta.caller_id":"Cronjob","correlation_id":"2bc333a5708b7937e37b230513f3222d","enqueued_at":"2021-05-03T21:11:03.602Z","pid":569,"message":"UserStatusCleanup::BatchWorker JID-2cb11b7fd4dbf3cc8f44c6ad: done: 0.094273 sec","job_status":"done","scheduling_latency_s":0.001601,"job_size_bytes":327,"cpu_s":0.002868,"redis_calls":2,"redis_duration_s":0.001275,"redis_read_bytes":2,"redis_write_bytes":202,"redis_queues_calls":2,"redis_queues_duration_s":0.001275,"redis_queues_read_bytes":2,"redis_queues_write_bytes":202,"db_count":1,"db_write_count":0,"db_cached_count":0,"duration_s":0.094273,"completed_at":"2021-05-03T21:11:03.698Z","db_duration_s":0.000809}
{"severity":"INFO","time":"2021-05-03T21:11:03.710Z","queue":"cronjob:schedule_merge_request_cleanup_refs","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","retry":0,"version":0,"queue_namespace":"cronjob","jid":"fcd0848fc73bd8a009a84f10","created_at":"2021-05-03T21:11:03.692Z","meta.caller_id":"Cronjob","correlation_id":"985ba13fad94c4990ad0a85fea77076e","enqueued_at":"2021-05-03T21:11:03.693Z","pid":569,"message":"ScheduleMergeRequestCleanupRefsWorker JID-fcd0848fc73bd8a009a84f10: done: 0.014553 sec","job_status":"done","scheduling_latency_s":0.003219,"job_size_bytes":343,"cpu_s":0.002335,"redis_calls":3,"redis_duration_s":0.000691,"redis_read_bytes":205,"redis_write_bytes":273,"redis_cache_calls":1,"redis_cache_duration_s":0.000261,"redis_cache_read_bytes":203,"redis_cache_write_bytes":61,"redis_queues_calls":2,"redis_queues_duration_s":0.00043,"redis_queues_read_bytes":2,"redis_queues_write_bytes":212,"db_count":0,"db_write_count":0,"db_cached_count":0,"duration_s":0.014553,"completed_at":"2021-05-03T21:11:03.710Z","db_duration_s":0.0}
==> /var/log/gitlab/gitlab-rails/production.log <==
Scoped order is ignored, it's forced to be batch order.
==> /var/log/gitlab/gitaly/current <==
{"correlation_id":"01F4T13VFR114C0S1AVCM111AS","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-sidekiq","grpc.meta.deadline_type":"unknown","grpc.method":"CreateBundle","grpc.request.deadline":"2021-05-04T03:11:04.119Z","grpc.request.fullMethod":"/gitaly.RepositoryService/CreateBundle","grpc.request.glProjectPath":"forbes-group/mmf-setup","grpc.request.glRepository":"project-81","grpc.request.repoPath":"@hashed/53/16/5316ca1c5ddca8e6ceccfce58f3b8540e540ee22f6180fb89492904051b3d531.git","grpc.request.repoStorage":"default","grpc.request.topLevelGroup":"@hashed","grpc.service":"gitaly.RepositoryService","grpc.start_time":"2021-05-03T21:11:04.119Z","grpc.time_ms":950.416,"level":"info","msg":"finished streaming call with code OK","peer.address":"@","pid":1035,"remote_ip":"134.121.19.107","span.kind":"server","system":"grpc","time":"2021-05-03T21:11:05.069Z","username":"mforbes"}
==> /var/log/gitlab/mercurial/mercurial.log <==
[2021-05-03 21:11:05 +0000] [12710] [INFO] [hgext3rd.loggingmod] jsonconf=None
[2021-05-03 21:11:05 +0000] [12710] [INFO] repo:None [hg.logging] Diverted all output to the standard Python logging module
[2021-05-03 21:11:06 +0000] [12710] [INFO] repo:/var/opt/gitlab/git-data/repositories/@hashed/53/16/5316ca1c5ddca8e6ceccfce58f3b8540e540ee22f6180fb89492904051b3d531.hg [hg.command] bundle --all '/var/opt/gitlab/gitlab-rails/shared/tmp/gitlab_exports/@hashed/53/16/5316ca1c5ddca8e6ceccfce58f3b8540e540ee22f6180fb89492904051b3d531/7a95e25729fbc2c739922972ad5be8da/df3f3601485ca90ee1028d953a0a6ab8/project.hg.bundle' --config 'ui.username=Heptapod system'
==> /var/log/gitlab/gitlab-exporter/current <==
2021-05-03_21:11:06.71480 127.0.0.1 - - [03/May/2021:21:11:06 UTC] "GET /sidekiq HTTP/1.1" 200 59486
2021-05-03_21:11:06.71541 - -> /sidekiq
==> /var/log/gitlab/mercurial/mercurial.log <==
[2021-05-03 21:11:06 +0000] [12710] [INFO] repo:None [hg.commandfinish] bundle --all '/var/opt/gitlab/gitlab-rails/shared/tmp/gitlab_exports/@hashed/53/16/5316ca1c5ddca8e6ceccfce58f3b8540e540ee22f6180fb89492904051b3d531/7a95e25729fbc2c739922972ad5be8da/df3f3601485ca90ee1028d953a0a6ab8/project.hg.bundle' --config 'ui.username=Heptapod system' exited 0 after 1.59 seconds
[2021-05-03 21:11:07 +0000] [12717] [INFO] [hgext3rd.loggingmod] jsonconf=None
[2021-05-03 21:11:07 +0000] [12717] [INFO] repo:None [hg.logging] Diverted all output to the standard Python logging module
[2021-05-03 21:11:07 +0000] [12717] [INFO] repo:/var/opt/gitlab/git-data/repositories/@hashed/53/16/5316ca1c5ddca8e6ceccfce58f3b8540e540ee22f6180fb89492904051b3d531.hg [hg.command] hpd-backup-additional '/var/opt/gitlab/gitlab-rails/shared/tmp/gitlab_exports/@hashed/53/16/5316ca1c5ddca8e6ceccfce58f3b8540e540ee22f6180fb89492904051b3d531/7a95e25729fbc2c739922972ad5be8da/df3f3601485ca90ee1028d953a0a6ab8/project.hg.config.tar' --config 'ui.username=Heptapod system'
[2021-05-03 21:11:08 +0000] [12717] [INFO] repo:None [hg.commandfinish] hpd-backup-additional '/var/opt/gitlab/gitlab-rails/shared/tmp/gitlab_exports/@hashed/53/16/5316ca1c5ddca8e6ceccfce58f3b8540e540ee22f6180fb89492904051b3d531/7a95e25729fbc2c739922972ad5be8da/df3f3601485ca90ee1028d953a0a6ab8/project.hg.config.tar' --config 'ui.username=Heptapod system' exited 0 after 1.25 seconds
==> /var/log/gitlab/gitlab-rails/exporter.log <==
{"severity":"ERROR","time":"2021-05-03T21:11:08.365Z","correlation_id":"01F4T13VFR114C0S1AVCM111AS","message":"Project export error","export_errors":"","project_name":"mmf-setup","project_id":81}
==> /var/log/gitlab/gitlab-rails/production.log <==
[ActiveJob] Enqueued ActionMailer::MailDeliveryJob (Job ID: 47e9c232-e04b-40b0-a323-c683b1ca0096) to Sidekiq(mailers) with arguments: "Notify", "project_was_not_exported_email", "deliver_now", {:args=>[#<GlobalID:0x00007f03869636e8 @uri=#<URI::GID gid://gitlab/User/2>>, #<GlobalID:0x00007f0386962fe0 @uri=#<URI::GID gid://gitlab/Project/81>>, []]}
==> /var/log/gitlab/sidekiq/current <==
{"severity":"INFO","time":"2021-05-03T21:11:08.391Z","class":"ActionMailer::MailDeliveryJob","queue":"mailers","args":["[FILTERED]"],"retry":3,"jid":"1c53034afe6d5336cb5990fb","created_at":"2021-05-03T21:11:08.388Z","meta.user":"mforbes","meta.project":"forbes-group/mmf-setup","meta.root_namespace":"forbes-group","meta.caller_id":"ProjectExportWorker","meta.remote_ip":"134.121.19.107","meta.feature_category":"importers","correlation_id":"01F4T13VFR114C0S1AVCM111AS","enqueued_at":"2021-05-03T21:11:08.389Z","pid":569,"message":"ActionMailer::MailDeliveryJob JID-1c53034afe6d5336cb5990fb: start","job_status":"start","scheduling_latency_s":0.00179,"job_size_bytes":956}
==> /var/log/gitlab/gitlab-rails/production.log <==
[ActiveJob] [ActionMailer::MailDeliveryJob] [47e9c232-e04b-40b0-a323-c683b1ca0096] Performing ActionMailer::MailDeliveryJob (Job ID: 47e9c232-e04b-40b0-a323-c683b1ca0096) from Sidekiq(mailers) enqueued at 2021-05-03T21:11:08Z with arguments: "Notify", "project_was_not_exported_email", "deliver_now", {:args=>[#<GlobalID:0x00007f03921bc4d8 @uri=#<URI::GID gid://gitlab/User/2>>, #<GlobalID:0x00007f03921b7c08 @uri=#<URI::GID gid://gitlab/Project/81>>, []]}
==> /var/log/gitlab/sidekiq/current <==
{"severity":"WARN","time":"2021-05-03T21:11:08.646Z","class":"ProjectExportWorker","args":["2","81","","{}"],"retry":0,"queue":"project_export","version":0,"backtrace":5,"dead":false,"status_expiration":21600,"jid":"bb142b850556a692c8dab9a1","created_at":"2021-05-03T21:11:00.954Z","meta.user":"mforbes","meta.project":"forbes-group/mmf-setup","meta.root_namespace":"forbes-group","meta.caller_id":"ProjectsController#export","meta.remote_ip":"134.121.19.107","meta.feature_category":"importers","correlation_id":"01F4T13VFR114C0S1AVCM111AS","enqueued_at":"2021-05-03T21:11:00.956Z","pid":569,"message":"ProjectExportWorker JID-bb142b850556a692c8dab9a1: fail: 7.686585 sec","job_status":"fail","scheduling_latency_s":0.002016,"job_size_bytes":513,"cpu_s":0.781659,"gitaly_calls":1,"gitaly_duration_s":0.941773,"rugged_calls":44,"rugged_duration_s":0.05661,"redis_calls":16,"redis_duration_s":0.00428,"redis_read_bytes":2627,"redis_write_bytes":2374,"redis_cache_calls":14,"redis_cache_duration_s":0.00389,"redis_cache_read_bytes":2568,"redis_cache_write_bytes":888,"redis_queues_calls":2,"redis_queues_duration_s":0.00039,"redis_queues_read_bytes":59,"redis_queues_write_bytes":1486,"db_count":135,"db_write_count":2,"db_cached_count":6,"duration_s":7.686585,"completed_at":"2021-05-03T21:11:08.645Z","error_message":"","error_class":"Gitlab::ImportExport::Error","error_backtrace":["app/services/projects/import_export/export_service.rb:115:in `notify_error!'","app/services/projects/import_export/export_service.rb:53:in `save_all!'","app/services/projects/import_export/export_service.rb:20:in `execute'","app/services/concerns/measurable.rb:35:in `execute'","app/workers/project_export_worker.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:40:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `block in call'","lib/gitlab/application_context.rb:56:in `block in use'","lib/gitlab/application_context.rb:56:in `use'","lib/gitlab/application_context.rb:22:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:15:in `call'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:8:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:37:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:8:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:7:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:19:in `call'"],"db_duration_s":1.537282}
==> /var/log/gitlab/gitlab-rails/production.log <==
[ActiveJob] [ActionMailer::MailDeliveryJob] [47e9c232-e04b-40b0-a323-c683b1ca0096] Delivered mail 609066ec6a409_239339a0236b1@757f4191f490.mail (355.6ms)
[ActiveJob] [ActionMailer::MailDeliveryJob] [47e9c232-e04b-40b0-a323-c683b1ca0096] Performed ActionMailer::MailDeliveryJob (Job ID: 47e9c232-e04b-40b0-a323-c683b1ca0096) from Sidekiq(mailers) in 377.48ms
==> /var/log/gitlab/sidekiq/current <==
{"severity":"INFO","time":"2021-05-03T21:11:08.792Z","class":"ActionMailer::MailDeliveryJob","queue":"mailers","args":["[FILTERED]"],"retry":3,"jid":"1c53034afe6d5336cb5990fb","created_at":"2021-05-03T21:11:08.388Z","meta.user":"mforbes","meta.project":"forbes-group/mmf-setup","meta.root_namespace":"forbes-group","meta.caller_id":"ProjectExportWorker","meta.remote_ip":"134.121.19.107","meta.feature_category":"importers","correlation_id":"01F4T13VFR114C0S1AVCM111AS","enqueued_at":"2021-05-03T21:11:08.389Z","pid":569,"message":"ActionMailer::MailDeliveryJob JID-1c53034afe6d5336cb5990fb: done: 0.401013 sec","job_status":"done","scheduling_latency_s":0.00179,"job_size_bytes":956,"cpu_s":0.029757,"redis_calls":3,"redis_duration_s":0.000851,"redis_read_bytes":1625,"redis_write_bytes":217,"redis_cache_calls":1,"redis_cache_duration_s":0.000282,"redis_cache_read_bytes":1623,"redis_cache_write_bytes":41,"redis_queues_calls":2,"redis_queues_duration_s":0.000569,"redis_queues_read_bytes":2,"redis_queues_write_bytes":176,"db_count":5,"db_write_count":0,"db_cached_count":0,"duration_s":0.401013,"completed_at":"2021-05-03T21:11:08.792Z","db_duration_s":0.016148}